-- Logs begin at Thu 2022-05-26 11:41:45 UTC, end at Thu 2022-05-26 13:06:38 UTC. -- May 26 12:22:37.140242 dv-cinder-815712-9-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 12:22:37.148228 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:22:37 2022] *** May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: nodename: dv-cinder-815712-9-iscsi May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: machine: x86_64 May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: clock source: unix May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: pcre jit disabled May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: detected number of CPU cores: 4 May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: current working directory: / May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: detected binary path: /usr/bin/uwsgi-core May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: your processes number limit is 47680 May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: your memory page size is 4096 bytes May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: detected max file descriptor number: 2048 May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: lock engine: pthread robust mutexes May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: thunder lock: enabled May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 12:22:37.152301 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:22:37.196334 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: Python main interpreter initialized at 0x55be768f99c0 May 26 12:22:37.196334 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: python threads support enabled May 26 12:22:37.196334 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: your server socket listen backlog is limited to 100 connections May 26 12:22:37.196334 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: your mercy for graceful operations on workers is 90 seconds May 26 12:22:37.196704 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:22:37.196779 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: *** Operational MODE: preforking *** May 26 12:22:37.197027 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: *** uWSGI is running in multiple interpreter mode *** May 26 12:22:37.197027 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: spawned uWSGI master process (pid: 80379) May 26 12:22:37.197234 dv-cinder-815712-9-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 12:22:37.201690 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: spawned uWSGI worker 1 (pid: 80393, cores: 1) May 26 12:22:37.201690 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: spawned uWSGI worker 2 (pid: 80394, cores: 1) May 26 12:22:37.201690 dv-cinder-815712-9-iscsi devstack@keystone.service[80379]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:22:42.909673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:22:42.909673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: from cryptography.utils import int_from_bytes May 26 12:22:42.910504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:22:42.910504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: from cryptography.utils import int_from_bytes May 26 12:22:42.911032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:22:42.911032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: from cryptography.utils import int_from_bytes May 26 12:22:42.911483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:22:42.911483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: from cryptography.utils import int_from_bytes May 26 12:22:42.958873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:22:42.959064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:22:42.959257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] command line args: [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:22:42.959525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:22:42.959705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ================================================================================ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:22:42.959958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] admin_token = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.960121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:22:42.960206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] config_dir = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.960319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:22:42.960408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.960515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] command line args: [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:22:42.960598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] config_source = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.960715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] debug = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.960791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:22:42.960912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.961172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ================================================================================ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:22:42.961243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] admin_token = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.961305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.961445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] config_dir = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.961529 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.961638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.961754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.961817 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] config_source = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.961947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.962027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] debug = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.962178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.962272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.962364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] log_config_append = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.962424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.962540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.962614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.962684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] log_dir = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.962820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.962897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] log_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.963069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.963153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.963302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.963400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.963472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_config_append = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.963543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.963652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.963784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.963877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_dir = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.963962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.964043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.964120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.964243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.964363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.964479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.964579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.964707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.964799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.964953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.965039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.965205 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.965324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.965403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.965474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.965544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.965653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.965774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.965919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.965994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.966190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.966274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.966454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.966675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.966759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.966857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] publish_errors = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.966933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.967088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.967176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.967316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.967400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.967493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.967737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.967888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.967965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.968073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] publish_errors = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.968192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] standard_threads = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.968309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.968472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.968552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.968651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.968737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.968828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.968946 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.969029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] use_journal = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.969165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] use_json = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.969240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.969367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] use_stderr = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.969442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] standard_threads = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.969517 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] use_syslog = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.969628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.969734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.969903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.969993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.970085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.970724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.970815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] use_journal = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.970953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] use_json = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.971035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.971117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] use_stderr = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.971218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.971294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] use_syslog = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.971466 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.971541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:22:42.971704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.971837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.971949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.972027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.972183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.972259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.972427 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.972511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.972672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.972748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.972918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.973001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.973151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.973236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.973391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.973465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.973623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.973729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.973899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.974057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.974137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.974207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.974367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.974444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.974620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.974720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.974872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.974954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.975113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.975190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.975348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.975436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.975598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.975675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.975856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.975932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.976108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.976186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.976352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.976427 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.976580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.976655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.976808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.976892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.977036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.977119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.977266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.977342 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.977513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.977590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.977780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.977862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.978011 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.978087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.978239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.978317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.978476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.978552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.978718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.978794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.978955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.979060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.979185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.979287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.979418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.979521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.979651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.979785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.979914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.980025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.980103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.980173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.980300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.980382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.980528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.980605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.980755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.980841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.980989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.981071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.981238 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.981321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.981466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.981542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.981714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.981796 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.981943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.982022 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.982177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.982256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.982410 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.982499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.982643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.982726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.982870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.982948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.983100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.983188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.983332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.983415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.983565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.983644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.983796 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.983884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.984029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.984107 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.984257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.984337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.984492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.984581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.984723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.984801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.984958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.985045 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.985185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.985271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.985414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.985492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.985679 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.985758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.985966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.986646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.986723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.986793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.986952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.987030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.987217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.987310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.987453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.987532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.987686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.987769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.987929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.988089 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.988169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.988344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.988422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.988601 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.988683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.988845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.988923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.989078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.989168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.989311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.989395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.989551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.989642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.989808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.989888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.990042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.990119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.990275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.990361 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.990509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.990587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.990743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.990819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.991001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.991088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.991243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.991321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.991482 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.991559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.991715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.991805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.991954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.992032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.992187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.992264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.992418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.992504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.992650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.992733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.992877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.992954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.993104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.993192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.993329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.993407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.993558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.993644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.993808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.993898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.994046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.994124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.994276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.994353 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.994509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.994594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.994740 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.994818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.994975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.995053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.995206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.995292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.995447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.995526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.995677 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.external = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.995754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.995906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.995992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.996150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.996228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.996406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.996484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.996632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.password = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.996720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.996859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] auth.token = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.996962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.997097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.997177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.external = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.997577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.997685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.997854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.997943 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.998087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.998166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.998333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.998411 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.password = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.998577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] auth.token = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.998663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.998806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.998890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.999041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.999119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.999288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.999374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.999522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.999601 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.999767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:42.999844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.000004 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.000163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.000238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.000307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.000462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.000540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.000712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.000803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.000963 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.001042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.001199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.001284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.001463 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.001550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.001735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.001819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.001980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.002061 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.002246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.002333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.002496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.002573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.002732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.002809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.002970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.003056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.003206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.003284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.003450 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.003529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.003693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.003772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.003920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.003997 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.004164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.004242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.004399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.004479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.004650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.004728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.004884 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.004961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.005134 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.005213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.005366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.005444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.005609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.005701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.005867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.005948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.006110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.006195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.006354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.006432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.006586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.006667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.006818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.006898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.007060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.007138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.007289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.007369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.007524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.007603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.007769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.007847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.008017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.008097 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.008246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.008325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.008474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.008552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.008702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.008790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.008940 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.009020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.009182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.009259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.009424 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.009504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.009655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.009787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.009907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.009984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.010140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.010220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.010387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.010466 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.010626 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.010702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.010855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.010935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.011089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.011168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.011321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.011399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.011553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.011633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.011791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.011869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.012029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.012106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.012274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.012354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.012503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.012581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.012732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.012818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.012968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.013047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.013199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.013276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.013440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.013525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.013700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.013781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.013935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.014023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.014168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.014254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.014394 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.014473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.014628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.014706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.014879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.014964 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.015128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.015335 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.015412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.015586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.015664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.015818 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.015898 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.016056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.016136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.016295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.016376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.016578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.016656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.016809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.016887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.017074 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.017179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.017322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.017555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.017635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.017829 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.017908 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.018063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.018211 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.018291 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.018448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.018526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.018701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.018780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.018953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.019040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.019192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.019270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.019431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.019509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.019669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.019749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.019899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.019976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.020127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.020205 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.020357 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.020437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.020588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.020666 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.020821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.020900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.021046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.021126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.021293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.021371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.021534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.021627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.021821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.021898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.022032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.022111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.022273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.022350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.022500 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.022586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.022742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.022821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.022976 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.023055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.023197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.023277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.023428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.023507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.023658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.023736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.023899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.023978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.024140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.024218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.024373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.024451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.024615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.024700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.024852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.024931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.025088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.025165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.025320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.025398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.025551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.025629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.025809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.025890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.026052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.026137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.026298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.026375 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.026528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.026606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.026762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.026842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.026998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.027076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.027232 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.027338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.027472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.027586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.027819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.027896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.028065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.028151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.028299 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.028377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.028538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.028615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.028781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.028866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.029015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.029092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.029254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.029332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.029487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] role.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.029573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.029753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] role.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.029834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.029986 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.030063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.030234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.030324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.030480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.030557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.030717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.030793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.030959 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.031045 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.031197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] role.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.031275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.031441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.031517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] role.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.031673 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.031758 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.031920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.032045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.032152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.032274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.032399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.032487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.032644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.033244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.033533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.033748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.033832 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.034005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.034189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.034267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.034426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.034505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.034677 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.034764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.034927 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.035005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.035174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.035252 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.035422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.035509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.035656 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.035735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.035909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.036048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.036160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.036288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.036399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.036541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.036620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.036793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.036883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.037042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.037121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.037312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.037425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.037563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.037712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.037845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.037920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.038260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.038713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.038829 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.038947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.039048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.039148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.039234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] token.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.039582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040526 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040712 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.040931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041211 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.041930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.042062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.042164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.042307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.042406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.042552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.042697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.042801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.042964 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.043118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.043206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.043366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.043453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.043602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.043681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.043848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.043926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.044098 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.044185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.044330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.044409 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.044563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.044639 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.044796 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.044949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.045025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.045117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.045260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.045348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.045501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.045600 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.045757 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.045850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.046007 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.046086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.046243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.046321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.046484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.046572 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.046713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.046791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.046950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.047028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.047181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.047268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.047342 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80393) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:22:43.047445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.047690 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.047926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.048175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.048472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.049296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.049534 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.049799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.050040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:22:43.050212 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80394) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:22:43.078190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.078420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.078995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.080312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.080548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.080779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.087727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.089415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.115950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.116180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.118026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.118262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.167786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.168243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.218512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.218763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.219826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.220065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.284435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.284656 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.284880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.285085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.285182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.285303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.285391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.285518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.285608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.285758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.285979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.286196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.308127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.308307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.308397 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.308547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.308636 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.308778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.308866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.308995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.309084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.309213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.309302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.309427 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.309518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.309704 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.320651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.321119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.338804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.339033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.339256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.339485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.339706 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.339922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.340135 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80393) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.340706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.340947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.341259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.341490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.341749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.341974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.342195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80394) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:22:43.359364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.359578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:22:43.359957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.360054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.360170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:22:43.360306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:22:43.360437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.360539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.360699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:22:43.360782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.360983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.361118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.361243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.361384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.361643 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.361922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.372295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.372823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.373023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.373118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.373297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.373566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.373875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.381440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.381899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.384713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.384992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.385130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.385273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.385407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.385557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.385708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.385992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.386084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.386259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.386340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.386514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.386594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.386797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.386888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.387072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.387153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.387352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.387433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.387623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.387711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.387922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.414901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.415242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.416606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.416851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.416941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.417132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.422139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.422372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.422467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.422655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.422745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.422935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.429876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.430156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.430274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.430554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.434569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.434970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.435138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.435255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.435421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.435541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.435707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.435816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.435993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.436081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.436271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.436351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.436546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.436634 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.436819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.437091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.456078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.456353 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.456932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.457215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.460968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.461905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.464584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.464877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.465522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.465843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.469901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.470923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.473467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.474509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.477219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.477517 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.477833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.478125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.478364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.478454 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.478671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.478761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.478965 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.479254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.479540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.479830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.497300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.497862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.498130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.498392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.498971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.499255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.499613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.499881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.506839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.508345 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.508531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.508811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.510092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.510380 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.511852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.512129 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.512411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.512701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.512977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.513401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.513700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.513993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.514278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.514556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.526935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.527214 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.527492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.527776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.528054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.528327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.528483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.528607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.528769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.529059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.529345 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.529629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.529930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.530214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.546352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.548176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.549599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.551473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.552887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.554509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.554849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.556124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.556421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.556510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.556704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.558108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.558399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.558693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.564528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.566190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.566669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.568260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.569414 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.569721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.570006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.570279 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.571510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.571804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.572091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.572371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.579325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.579666 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.580535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.582189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.582479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.582762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.588323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80393) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.588600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.588880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.589156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.589435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.589731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.590033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.590302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.590577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.590687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80394) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:22:43.590845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.590971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.591122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.591256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.591382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.591534 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.591650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.591808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.591910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80393) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.592083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.592379 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.592653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.592932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.593204 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.593484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.593781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.594057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.594325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80394) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:22:43.631342 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be768f99c0 pid: 80393 (default app) May 26 12:22:43.634018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be768f99c0 pid: 80394 (default app) May 26 12:22:43.634599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea378ff3-42d2-4f93-858a-540c8c99347e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:43.634901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea378ff3-42d2-4f93-858a-540c8c99347e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:43.635180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea378ff3-42d2-4f93-858a-540c8c99347e None None] PATH_INFO: `/v3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:43.639528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 791 bytes} [Thu May 26 12:22:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:52.570889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbdab4-b641-4f9c-9553-86e4dab1545c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:52.571405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbdab4-b641-4f9c-9553-86e4dab1545c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:52.571483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbdab4-b641-4f9c-9553-86e4dab1545c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:52.575749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1/2] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:22:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:52.580926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:52.581343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:52.581489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:52.649874 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: INFO dbcounter [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] Registered counter for database keystone May 26 12:22:52.671538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG oslo_db.sqlalchemy.engines [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80393) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:22:52.678466 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writer thread running {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:22:52.855527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG passlib.handlers.bcrypt [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80393) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 12:22:52.855940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG passlib.handlers.bcrypt [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80393) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 12:22:52.911313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:52.912891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:53.033684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:22:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 12:22:53.177352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbdab4-b641-4f9c-9553-86e4dab1545c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:53.244986 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: INFO dbcounter [None req-e4dbdab4-b641-4f9c-9553-86e4dab1545c None None] Registered counter for database keystone May 26 12:22:53.264662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG oslo_db.sqlalchemy.engines [None req-e4dbdab4-b641-4f9c-9553-86e4dab1545c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80394) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:22:53.271403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writer thread running {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:22:53.391890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbdab4-b641-4f9c-9553-86e4dab1545c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:53.396595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45813ef-9d76-43a2-9c45-6dd224771a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:53.397249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45813ef-9d76-43a2-9c45-6dd224771a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:53.397535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45813ef-9d76-43a2-9c45-6dd224771a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:53.397842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45813ef-9d76-43a2-9c45-6dd224771a4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:53.405846 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45813ef-9d76-43a2-9c45-6dd224771a4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:53.456844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a45813ef-9d76-43a2-9c45-6dd224771a4c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 12:22:53.457129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45813ef-9d76-43a2-9c45-6dd224771a4c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:53.467261 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 2/4] 10.222.0.41 () {58 vars in 1324 bytes} [Thu May 26 12:22:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:22:53.473564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:53.488108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712fc1f-c42c-486c-98bc-39471a078af3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:53.492532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a6001-9702-403e-840f-561407b692f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:53.493653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a6001-9702-403e-840f-561407b692f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:53.493970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a6001-9702-403e-840f-561407b692f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:53.494247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a6001-9702-403e-840f-561407b692f8 admin admin] PATH_INFO: `/v3/projects/787f9c4d2f4e4a9fbcf0543d5d8232c5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:53.495750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a6001-9702-403e-840f-561407b692f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=787f9c4d2f4e4a9fbcf0543d5d8232c5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:53.654312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d56a6001-9702-403e-840f-561407b692f8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 12:22:53.654952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a6001-9702-403e-840f-561407b692f8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:53.659428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 3/5] 10.222.0.41 () {56 vars in 1207 bytes} [Thu May 26 12:22:53 2022] GET /identity/v3/projects/787f9c4d2f4e4a9fbcf0543d5d8232c5 => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:55.800075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab171-36f6-4bdf-8881-1c4f2af786cb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:55.800636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab171-36f6-4bdf-8881-1c4f2af786cb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:55.800636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab171-36f6-4bdf-8881-1c4f2af786cb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:55.804786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 3/6] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:22:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:55.810287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e7a57-3242-4659-abce-bea2697aedeb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:55.810677 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e7a57-3242-4659-abce-bea2697aedeb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:55.810856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e7a57-3242-4659-abce-bea2697aedeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:55.830790 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c08e7a57-3242-4659-abce-bea2697aedeb None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:55.832345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c08e7a57-3242-4659-abce-bea2697aedeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:55.840267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 4/7] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:22:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 12:22:55.862979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feab171-36f6-4bdf-8881-1c4f2af786cb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:55.875288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feab171-36f6-4bdf-8881-1c4f2af786cb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:55.879485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf8e0b-fb77-47c7-9033-e7bea75a4feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:55.880118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8e0b-fb77-47c7-9033-e7bea75a4feb admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:55.880404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8e0b-fb77-47c7-9033-e7bea75a4feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:55.880685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf8e0b-fb77-47c7-9033-e7bea75a4feb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:55.888267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf8e0b-fb77-47c7-9033-e7bea75a4feb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:55.890065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf8e0b-fb77-47c7-9033-e7bea75a4feb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:55.899349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 4/8] 10.222.0.41 () {58 vars in 1324 bytes} [Thu May 26 12:22:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:22:55.904658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e7a57-3242-4659-abce-bea2697aedeb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:55.914518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e7a57-3242-4659-abce-bea2697aedeb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:55.918931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59552a6-181a-45ee-95e0-8d65ac9013a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:55.919791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59552a6-181a-45ee-95e0-8d65ac9013a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:55.920082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59552a6-181a-45ee-95e0-8d65ac9013a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:55.920367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59552a6-181a-45ee-95e0-8d65ac9013a0 admin admin] PATH_INFO: `/v3/users/46fa2a18bf5f49108e7df3a32506426e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:55.921793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59552a6-181a-45ee-95e0-8d65ac9013a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=46fa2a18bf5f49108e7df3a32506426e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:55.923605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59552a6-181a-45ee-95e0-8d65ac9013a0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:55.925158 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 5/9] 10.222.0.41 () {56 vars in 1198 bytes} [Thu May 26 12:22:55 2022] GET /identity/v3/users/46fa2a18bf5f49108e7df3a32506426e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:22:58.139788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83907e9-5feb-4aaf-8042-91fa6f20cb50 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:58.140300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83907e9-5feb-4aaf-8042-91fa6f20cb50 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:58.140382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83907e9-5feb-4aaf-8042-91fa6f20cb50 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:58.141731 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 5/10] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:22:58.146938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde11f-1bd8-4a12-9cc3-0f85716f7b9f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:58.147362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde11f-1bd8-4a12-9cc3-0f85716f7b9f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:58.147509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bde11f-1bd8-4a12-9cc3-0f85716f7b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:58.163957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b3bde11f-1bd8-4a12-9cc3-0f85716f7b9f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:58.165142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b3bde11f-1bd8-4a12-9cc3-0f85716f7b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:58.186835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479c9f6-5645-4c5a-a680-47831eb8fdfe None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:58.187132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479c9f6-5645-4c5a-a680-47831eb8fdfe None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:58.187415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479c9f6-5645-4c5a-a680-47831eb8fdfe None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:58.189338 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 6/11] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:22:58.194284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e59f2-1908-43c7-afdf-816cfc990aa6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:58.194596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e59f2-1908-43c7-afdf-816cfc990aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:58.194845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e59f2-1908-43c7-afdf-816cfc990aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:58.233445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG passlib.handlers.bcrypt [None req-ff7e59f2-1908-43c7-afdf-816cfc990aa6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80394) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 12:22:58.233901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG passlib.handlers.bcrypt [None req-ff7e59f2-1908-43c7-afdf-816cfc990aa6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80394) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 12:22:58.245261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 6/12] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:22:58.268743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bde11f-1bd8-4a12-9cc3-0f85716f7b9f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:58.281048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ff7e59f2-1908-43c7-afdf-816cfc990aa6 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:22:58.282709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ff7e59f2-1908-43c7-afdf-816cfc990aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:22:58.291038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:58.371725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bde11f-1bd8-4a12-9cc3-0f85716f7b9f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:58.382137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 7/13] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:22:58.403920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e59f2-1908-43c7-afdf-816cfc990aa6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:58.404717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0f4b-7a2d-4852-8252-73a452c9583b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:58.405513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0f4b-7a2d-4852-8252-73a452c9583b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:58.405842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0f4b-7a2d-4852-8252-73a452c9583b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:58.406121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0f4b-7a2d-4852-8252-73a452c9583b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:58.419853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e0f4b-7a2d-4852-8252-73a452c9583b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-920e0f4b-7a2d-4852-8252-73a452c9583b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:22:58.431057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:58.431971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:22:58.432810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 7/14] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:22:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:58.437857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0f4b-7a2d-4852-8252-73a452c9583b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:58.520822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:58.539480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0f4b-7a2d-4852-8252-73a452c9583b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:58.576164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321bdc0-20cc-4349-ad71-48263d1177fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:58.576845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321bdc0-20cc-4349-ad71-48263d1177fe None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:58.577133 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321bdc0-20cc-4349-ad71-48263d1177fe None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:58.577412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321bdc0-20cc-4349-ad71-48263d1177fe None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:58.578214 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321bdc0-20cc-4349-ad71-48263d1177fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:58.578525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321bdc0-20cc-4349-ad71-48263d1177fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:58.580511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321bdc0-20cc-4349-ad71-48263d1177fe None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:58.592786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 8/15] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:22:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:58.598444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321bdc0-20cc-4349-ad71-48263d1177fe None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:58.614218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e59f2-1908-43c7-afdf-816cfc990aa6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:58.616496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:58.651468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eeeeb-f7c5-4485-9b9f-f41df46ef1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:58.652292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eeeeb-f7c5-4485-9b9f-f41df46ef1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:58.652577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eeeeb-f7c5-4485-9b9f-f41df46ef1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:58.652855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eeeeb-f7c5-4485-9b9f-f41df46ef1f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:58.697317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321bdc0-20cc-4349-ad71-48263d1177fe None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:58.720029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eeeeb-f7c5-4485-9b9f-f41df46ef1f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:58.721560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eeeeb-f7c5-4485-9b9f-f41df46ef1f3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:58.729506 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23220f-af39-4bc0-bcac-27869d252588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:58.730391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23220f-af39-4bc0-bcac-27869d252588 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:58.730674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23220f-af39-4bc0-bcac-27869d252588 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:58.730952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23220f-af39-4bc0-bcac-27869d252588 None admin] PATH_INFO: `/v3/users/46fa2a18bf5f49108e7df3a32506426e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:58.732161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23220f-af39-4bc0-bcac-27869d252588 None admin] RBAC: Authorizing `identity:get_user(user_id=46fa2a18bf5f49108e7df3a32506426e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:58.733602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23220f-af39-4bc0-bcac-27869d252588 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:58.735225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 9/16] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:22:58 2022] GET /identity/v3/users/46fa2a18bf5f49108e7df3a32506426e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:58.740503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23220f-af39-4bc0-bcac-27869d252588 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:58.756084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:58.819020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 8/17] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:22:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:22:58.824433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eeeeb-f7c5-4485-9b9f-f41df46ef1f3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:58.827169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:58.838160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23220f-af39-4bc0-bcac-27869d252588 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:58.871109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbf6b3-f58a-4c03-85ea-60ef3be22d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:58.871918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbf6b3-f58a-4c03-85ea-60ef3be22d90 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:58.872462 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbf6b3-f58a-4c03-85ea-60ef3be22d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:58.872742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbf6b3-f58a-4c03-85ea-60ef3be22d90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:58.873931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbf6b3-f58a-4c03-85ea-60ef3be22d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:58.875375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbf6b3-f58a-4c03-85ea-60ef3be22d90 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:58.877804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 10/18] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:22:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:58.883047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbf6b3-f58a-4c03-85ea-60ef3be22d90 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:58.923619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eeeeb-f7c5-4485-9b9f-f41df46ef1f3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:58.956334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c25a-bf6b-40bb-a55f-440567ecad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:58.957128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c25a-bf6b-40bb-a55f-440567ecad49 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:58.957412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c25a-bf6b-40bb-a55f-440567ecad49 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:58.957713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c25a-bf6b-40bb-a55f-440567ecad49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:58.960835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:58.977725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018c25a-bf6b-40bb-a55f-440567ecad49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:58.979225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018c25a-bf6b-40bb-a55f-440567ecad49 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:58.981569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbf6b3-f58a-4c03-85ea-60ef3be22d90 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6018c25a-bf6b-40bb-a55f-440567ecad49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:22:59.001855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:22:59.002849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:22:59.003814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:22:59.003814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:22:59.003814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:22:59.003814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:22:59.005523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 9/19] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:22:59.011344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c25a-bf6b-40bb-a55f-440567ecad49 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:22:59.025354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed9426-aff7-42aa-9e40-a11363538262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:59.026130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9426-aff7-42aa-9e40-a11363538262 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:59.026507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9426-aff7-42aa-9e40-a11363538262 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:59.026996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed9426-aff7-42aa-9e40-a11363538262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:59.028035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed9426-aff7-42aa-9e40-a11363538262 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.domain.id=default, user.id=46fa2a18bf5f49108e7df3a32506426e) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:59.028540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed9426-aff7-42aa-9e40-a11363538262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:59.030272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed9426-aff7-42aa-9e40-a11363538262 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:59.041578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 11/20] 10.222.0.41 () {56 vars in 1322 bytes} [Thu May 26 12:22:58 2022] GET /identity/v3/role_assignments?user.id=46fa2a18bf5f49108e7df3a32506426e&scope.domain.id=default&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:22:59.086143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:22:59.135472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c25a-bf6b-40bb-a55f-440567ecad49 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:22:59.172423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7d249a-f287-47f5-9540-764e0103a763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:22:59.173142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d249a-f287-47f5-9540-764e0103a763 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:22:59.173419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d249a-f287-47f5-9540-764e0103a763 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:22:59.173782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7d249a-f287-47f5-9540-764e0103a763 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:22:59.174486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d249a-f287-47f5-9540-764e0103a763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:22:59.174798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d249a-f287-47f5-9540-764e0103a763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:22:59.176218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7d249a-f287-47f5-9540-764e0103a763 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:22:59.197400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 10/21] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:01.524943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297ce6d-025a-41ce-adf7-404becfc772a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:01.524943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297ce6d-025a-41ce-adf7-404becfc772a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:01.524943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297ce6d-025a-41ce-adf7-404becfc772a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:01.526038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 12/22] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:01.531719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19420-b123-49c0-84ab-4d1c74e09b76 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:01.533083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19420-b123-49c0-84ab-4d1c74e09b76 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:01.533561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19420-b123-49c0-84ab-4d1c74e09b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:01.551952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fdb19420-b123-49c0-84ab-4d1c74e09b76 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:01.553488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fdb19420-b123-49c0-84ab-4d1c74e09b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:01.643523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 11/23] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:01.674612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297ce6d-025a-41ce-adf7-404becfc772a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:01.823393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297ce6d-025a-41ce-adf7-404becfc772a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:01.875523 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a462f-563e-4ca1-add6-3e700d03e75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:01.876374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a462f-563e-4ca1-add6-3e700d03e75b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:01.876663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a462f-563e-4ca1-add6-3e700d03e75b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:01.876941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a462f-563e-4ca1-add6-3e700d03e75b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:01.893009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a462f-563e-4ca1-add6-3e700d03e75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8a6a462f-563e-4ca1-add6-3e700d03e75b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:01.900849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:01.901659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:01.902399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 13/24] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:23:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:01.909911 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19420-b123-49c0-84ab-4d1c74e09b76 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:01.953773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993723-cd92-4594-b1f5-f7e6e50b1c07 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:01.953773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993723-cd92-4594-b1f5-f7e6e50b1c07 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:01.954568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993723-cd92-4594-b1f5-f7e6e50b1c07 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:01.956433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 14/25] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:01.957573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f6801-6292-42a8-aa14-0bc965c9c7a6 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:01.958089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f6801-6292-42a8-aa14-0bc965c9c7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:01.958624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f6801-6292-42a8-aa14-0bc965c9c7a6 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:01.960039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 15/26] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:01.965227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b344234-d571-4be7-b664-65b1501edbe0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:01.965764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b344234-d571-4be7-b664-65b1501edbe0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:01.966243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b344234-d571-4be7-b664-65b1501edbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:01.973136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:01.985060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0b344234-d571-4be7-b664-65b1501edbe0 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:01.986803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0b344234-d571-4be7-b664-65b1501edbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:02.006214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:02.059043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 16/27] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:02.060343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d30f1-9bc1-4631-9189-4a4867a6a5ac None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.060642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d30f1-9bc1-4631-9189-4a4867a6a5ac None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.060923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8d30f1-9bc1-4631-9189-4a4867a6a5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.096580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3d8d30f1-9bc1-4631-9189-4a4867a6a5ac None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:02.097797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3d8d30f1-9bc1-4631-9189-4a4867a6a5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:02.142452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19420-b123-49c0-84ab-4d1c74e09b76 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:02.204778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 17/28] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:02.205447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d30f1-9bc1-4631-9189-4a4867a6a5ac None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:02.210422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54adb3c-de4b-42d3-ba7a-bef4cf3687d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:02.211098 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54adb3c-de4b-42d3-ba7a-bef4cf3687d7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.211384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54adb3c-de4b-42d3-ba7a-bef4cf3687d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.211667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54adb3c-de4b-42d3-ba7a-bef4cf3687d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.212431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54adb3c-de4b-42d3-ba7a-bef4cf3687d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:02.212747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54adb3c-de4b-42d3-ba7a-bef4cf3687d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:02.220161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54adb3c-de4b-42d3-ba7a-bef4cf3687d7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:02.243934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 12/29] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:02.250055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54adb3c-de4b-42d3-ba7a-bef4cf3687d7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:02.284489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:02.326996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8d30f1-9bc1-4631-9189-4a4867a6a5ac None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:02.365534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900aec6-987e-42d3-848d-0c6c6ce775fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:02.366633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900aec6-987e-42d3-848d-0c6c6ce775fb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.367089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900aec6-987e-42d3-848d-0c6c6ce775fb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.368094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2900aec6-987e-42d3-848d-0c6c6ce775fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.381956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900aec6-987e-42d3-848d-0c6c6ce775fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:02.383716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2900aec6-987e-42d3-848d-0c6c6ce775fb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2900aec6-987e-42d3-848d-0c6c6ce775fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:23:02.406247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:02.407290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:02.408245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:23:02.408245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:23:02.408245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:23:02.408245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:02.409952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 18/30] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:02.411012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900aec6-987e-42d3-848d-0c6c6ce775fb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:02.466827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54adb3c-de4b-42d3-ba7a-bef4cf3687d7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:02.477460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:02.503464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c27ff0-3c36-4bd3-9def-272e2bbfc63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:02.504667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c27ff0-3c36-4bd3-9def-272e2bbfc63d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.505154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c27ff0-3c36-4bd3-9def-272e2bbfc63d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.505706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c27ff0-3c36-4bd3-9def-272e2bbfc63d None admin] PATH_INFO: `/v3/users/46fa2a18bf5f49108e7df3a32506426e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.507585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c27ff0-3c36-4bd3-9def-272e2bbfc63d None admin] RBAC: Authorizing `identity:get_user(user_id=46fa2a18bf5f49108e7df3a32506426e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:02.509210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c27ff0-3c36-4bd3-9def-272e2bbfc63d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:02.511100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 13/31] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:02 2022] GET /identity/v3/users/46fa2a18bf5f49108e7df3a32506426e => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:02.512479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c7b82-5d41-4ae6-9875-59eb075817ac None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.513098 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c7b82-5d41-4ae6-9875-59eb075817ac None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.513603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c7b82-5d41-4ae6-9875-59eb075817ac None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.515169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 14/32] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:02.516435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c7b82-5d41-4ae6-9875-59eb075817ac None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:02.545887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2900aec6-987e-42d3-848d-0c6c6ce775fb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:02.564648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:02.589411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374683-2967-49a1-8a4c-1b504aec2523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:02.590134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374683-2967-49a1-8a4c-1b504aec2523 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.590423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374683-2967-49a1-8a4c-1b504aec2523 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.590700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac374683-2967-49a1-8a4c-1b504aec2523 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.591697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374683-2967-49a1-8a4c-1b504aec2523 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:02.593766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac374683-2967-49a1-8a4c-1b504aec2523 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:02.638034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c7b82-5d41-4ae6-9875-59eb075817ac None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:02.673766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603034b-26fa-4d1c-8929-8374e3bafce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:02.674485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603034b-26fa-4d1c-8929-8374e3bafce8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.674773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603034b-26fa-4d1c-8929-8374e3bafce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.675058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603034b-26fa-4d1c-8929-8374e3bafce8 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.675786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603034b-26fa-4d1c-8929-8374e3bafce8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:02.677955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603034b-26fa-4d1c-8929-8374e3bafce8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:02.677955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603034b-26fa-4d1c-8929-8374e3bafce8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:02.695199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 15/33] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:02.695199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603034b-26fa-4d1c-8929-8374e3bafce8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:02.735897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:02.807408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603034b-26fa-4d1c-8929-8374e3bafce8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:02.844619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba96cdd-661e-42b5-9dee-3819d3d85cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:02.845414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96cdd-661e-42b5-9dee-3819d3d85cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.845717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96cdd-661e-42b5-9dee-3819d3d85cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.846002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba96cdd-661e-42b5-9dee-3819d3d85cb1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.847186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba96cdd-661e-42b5-9dee-3819d3d85cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:02.848780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba96cdd-661e-42b5-9dee-3819d3d85cb1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:02.851068 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 16/34] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:02.852396 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644a180-6d39-40ad-8783-a2835ea6dc1a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:02.852686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644a180-6d39-40ad-8783-a2835ea6dc1a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:02.852964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644a180-6d39-40ad-8783-a2835ea6dc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:02.854873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 19/35] 10.222.0.41 () {60 vars in 1131 bytes} [Thu May 26 12:23:02 2022] POST /identity/v3/roles => generated 219 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:02.856092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374683-2967-49a1-8a4c-1b504aec2523 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:02.877009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7644a180-6d39-40ad-8783-a2835ea6dc1a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:02.878934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7644a180-6d39-40ad-8783-a2835ea6dc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:02.962448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 17/36] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:02.963578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644a180-6d39-40ad-8783-a2835ea6dc1a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:02.987880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac374683-2967-49a1-8a4c-1b504aec2523 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:03.001605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:03.025602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533499-9740-44bf-af47-07e3944892dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:03.026323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533499-9740-44bf-af47-07e3944892dc None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.026673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533499-9740-44bf-af47-07e3944892dc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.026960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533499-9740-44bf-af47-07e3944892dc None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.027676 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533499-9740-44bf-af47-07e3944892dc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:03.029384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533499-9740-44bf-af47-07e3944892dc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:03.088852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644a180-6d39-40ad-8783-a2835ea6dc1a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:03.128551 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf27d1c-3e47-4d1e-a16e-4d7afd642e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:03.129473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf27d1c-3e47-4d1e-a16e-4d7afd642e44 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.129787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf27d1c-3e47-4d1e-a16e-4d7afd642e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.130072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf27d1c-3e47-4d1e-a16e-4d7afd642e44 None admin] PATH_INFO: `/v3/domains/default/users/46fa2a18bf5f49108e7df3a32506426e/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.132156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf27d1c-3e47-4d1e-a16e-4d7afd642e44 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=46fa2a18bf5f49108e7df3a32506426e, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:03.133631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf27d1c-3e47-4d1e-a16e-4d7afd642e44 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:03.215097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 20/37] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:23:02 2022] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:03.215097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533499-9740-44bf-af47-07e3944892dc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:03.246557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:03.333533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533499-9740-44bf-af47-07e3944892dc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:03.372514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5f11d-7928-41d3-a0d6-83b866fd930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:03.373374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5f11d-7928-41d3-a0d6-83b866fd930f None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.373799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5f11d-7928-41d3-a0d6-83b866fd930f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.374176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5f11d-7928-41d3-a0d6-83b866fd930f None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.375029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5f11d-7928-41d3-a0d6-83b866fd930f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:03.376645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e5f11d-7928-41d3-a0d6-83b866fd930f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:03.403931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 18/38] 10.222.0.41 () {58 vars in 1361 bytes} [Thu May 26 12:23:02 2022] PUT /identity/v3/domains/default/users/46fa2a18bf5f49108e7df3a32506426e/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:03.405975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8742b81-0b72-43af-917f-e3bd9025b13e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.406277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8742b81-0b72-43af-917f-e3bd9025b13e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.406563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8742b81-0b72-43af-917f-e3bd9025b13e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.411874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 19/39] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:03.417843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73b1ac-baa6-4d93-a624-1c9c4ca2e821 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.418161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73b1ac-baa6-4d93-a624-1c9c4ca2e821 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.418446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73b1ac-baa6-4d93-a624-1c9c4ca2e821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.438512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6b73b1ac-baa6-4d93-a624-1c9c4ca2e821 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:03.440175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6b73b1ac-baa6-4d93-a624-1c9c4ca2e821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:03.487291 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1131 bytes} [Thu May 26 12:23:03 2022] POST /identity/v3/roles => generated 225 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:03.530183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 20/41] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:03.556736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5f11d-7928-41d3-a0d6-83b866fd930f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:03.652571 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae72b72-5c7f-4405-acdc-1c9a5302f0e0 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.653111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae72b72-5c7f-4405-acdc-1c9a5302f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.653111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae72b72-5c7f-4405-acdc-1c9a5302f0e0 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.654560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 21/42] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:03.661269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a112-fd8d-46d1-9522-28a9d60cdecf None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.661562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a112-fd8d-46d1-9522-28a9d60cdecf None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.661933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632a112-fd8d-46d1-9522-28a9d60cdecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.675656 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:03.689684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2632a112-fd8d-46d1-9522-28a9d60cdecf None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:03.691004 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2632a112-fd8d-46d1-9522-28a9d60cdecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:03.698671 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5f11d-7928-41d3-a0d6-83b866fd930f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:03.712183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:03.750448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbeb0e-3a0a-40b6-a511-59cb2894c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:03.751653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbeb0e-3a0a-40b6-a511-59cb2894c42e None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.751947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbeb0e-3a0a-40b6-a511-59cb2894c42e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.752233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbeb0e-3a0a-40b6-a511-59cb2894c42e None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.752993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbeb0e-3a0a-40b6-a511-59cb2894c42e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:03.754427 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffbeb0e-3a0a-40b6-a511-59cb2894c42e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:03.774925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 22/43] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:03.798043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632a112-fd8d-46d1-9522-28a9d60cdecf None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:03.877690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 22/44] 10.222.0.41 () {60 vars in 1131 bytes} [Thu May 26 12:23:03 2022] POST /identity/v3/roles => generated 223 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:03.906482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632a112-fd8d-46d1-9522-28a9d60cdecf None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:03.943614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd07cc-429d-4631-9011-81940830ac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:03.944432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd07cc-429d-4631-9011-81940830ac2d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:03.944721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd07cc-429d-4631-9011-81940830ac2d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:03.945000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd07cc-429d-4631-9011-81940830ac2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:03.946302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd07cc-429d-4631-9011-81940830ac2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:03.947936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd07cc-429d-4631-9011-81940830ac2d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:03.954646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 23/45] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:03.956748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbeb0e-3a0a-40b6-a511-59cb2894c42e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:04.072323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbeb0e-3a0a-40b6-a511-59cb2894c42e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:04.108652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a11dd-bf0d-46c9-a0be-5788e2cbc27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:04.109322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a11dd-bf0d-46c9-a0be-5788e2cbc27e None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:04.109605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a11dd-bf0d-46c9-a0be-5788e2cbc27e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:04.109935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a11dd-bf0d-46c9-a0be-5788e2cbc27e None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:04.111244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a11dd-bf0d-46c9-a0be-5788e2cbc27e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:04.112701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a11dd-bf0d-46c9-a0be-5788e2cbc27e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:04.218883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:04.224769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 23/46] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:23:03 2022] POST /identity/v3/projects => generated 312 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:05.700139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0627a-e6e1-4ec1-abd3-42ee5351cad4 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:05.700676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0627a-e6e1-4ec1-abd3-42ee5351cad4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:05.700758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0627a-e6e1-4ec1-abd3-42ee5351cad4 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:05.702140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 24/47] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:05.707612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f3a75-cfbd-4d50-bede-86165573cf08 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:05.708019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f3a75-cfbd-4d50-bede-86165573cf08 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:05.708189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020f3a75-cfbd-4d50-bede-86165573cf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:05.724673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-020f3a75-cfbd-4d50-bede-86165573cf08 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:05.726202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-020f3a75-cfbd-4d50-bede-86165573cf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:05.790747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 24/48] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:05.813183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0627a-e6e1-4ec1-abd3-42ee5351cad4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:05.837553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:05.914577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0627a-e6e1-4ec1-abd3-42ee5351cad4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:05.947433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca7a5c-a46b-4975-b8de-acea8eab162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:05.948221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca7a5c-a46b-4975-b8de-acea8eab162e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:05.948510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca7a5c-a46b-4975-b8de-acea8eab162e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:05.948789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca7a5c-a46b-4975-b8de-acea8eab162e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:05.960401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca7a5c-a46b-4975-b8de-acea8eab162e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-25ca7a5c-a46b-4975-b8de-acea8eab162e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:05.969023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:05.969858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:05.970584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 25/49] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:23:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:05.976083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f3a75-cfbd-4d50-bede-86165573cf08 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:06.072498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020f3a75-cfbd-4d50-bede-86165573cf08 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:06.103231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:06.108535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5015f5-9a9b-4fed-bf17-91908e51c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:06.109210 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5015f5-9a9b-4fed-bf17-91908e51c956 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:06.109500 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5015f5-9a9b-4fed-bf17-91908e51c956 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:06.109813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5015f5-9a9b-4fed-bf17-91908e51c956 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:06.110609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5015f5-9a9b-4fed-bf17-91908e51c956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:06.110919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5015f5-9a9b-4fed-bf17-91908e51c956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:06.112320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5015f5-9a9b-4fed-bf17-91908e51c956 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:06.120434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 25/50] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:06.126734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca7a5c-a46b-4975-b8de-acea8eab162e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:06.208491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:06.227415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca7a5c-a46b-4975-b8de-acea8eab162e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:06.264458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8d2c9-44e2-47c7-b673-3ac17dac1358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:06.265335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8d2c9-44e2-47c7-b673-3ac17dac1358 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:06.265621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8d2c9-44e2-47c7-b673-3ac17dac1358 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:06.265935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8d2c9-44e2-47c7-b673-3ac17dac1358 None admin] PATH_INFO: `/v3/users/46fa2a18bf5f49108e7df3a32506426e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:06.267764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8d2c9-44e2-47c7-b673-3ac17dac1358 None admin] RBAC: Authorizing `identity:get_user(user_id=46fa2a18bf5f49108e7df3a32506426e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:06.269223 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c8d2c9-44e2-47c7-b673-3ac17dac1358 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:06.270883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 26/51] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:06 2022] GET /identity/v3/users/46fa2a18bf5f49108e7df3a32506426e => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:06.276206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5015f5-9a9b-4fed-bf17-91908e51c956 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:06.373197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5015f5-9a9b-4fed-bf17-91908e51c956 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:06.406390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4b252-38bf-4cca-8ba9-5afde68fdece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:06.407181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4b252-38bf-4cca-8ba9-5afde68fdece None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:06.407475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4b252-38bf-4cca-8ba9-5afde68fdece None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:06.407760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4b252-38bf-4cca-8ba9-5afde68fdece None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:06.408942 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4b252-38bf-4cca-8ba9-5afde68fdece None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:06.410441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4b252-38bf-4cca-8ba9-5afde68fdece None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:06.412056 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 26/52] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:06.414061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210b70-1026-4ba6-b3ac-c5b716fd4728 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:06.414360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210b70-1026-4ba6-b3ac-c5b716fd4728 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:06.414644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e210b70-1026-4ba6-b3ac-c5b716fd4728 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:06.415993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 27/53] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:06.417612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4b252-38bf-4cca-8ba9-5afde68fdece None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:06.420669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce7212-2ce9-4314-bd35-61a5e8101b3c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:06.420958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce7212-2ce9-4314-bd35-61a5e8101b3c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:06.421241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ce7212-2ce9-4314-bd35-61a5e8101b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:06.438294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-95ce7212-2ce9-4314-bd35-61a5e8101b3c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:06.440012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-95ce7212-2ce9-4314-bd35-61a5e8101b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:06.480163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:06.506419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 28/54] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:06.519371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4b252-38bf-4cca-8ba9-5afde68fdece None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:06.529264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce7212-2ce9-4314-bd35-61a5e8101b3c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:06.552200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b97f6-730c-478b-987a-947c6bfb254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:06.552861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b97f6-730c-478b-987a-947c6bfb254f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:06.553152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b97f6-730c-478b-987a-947c6bfb254f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:06.553429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b97f6-730c-478b-987a-947c6bfb254f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:06.554299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b97f6-730c-478b-987a-947c6bfb254f None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.domain.id=default, user.id=46fa2a18bf5f49108e7df3a32506426e) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:06.554613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b97f6-730c-478b-987a-947c6bfb254f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:06.556103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b97f6-730c-478b-987a-947c6bfb254f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:06.577697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1322 bytes} [Thu May 26 12:23:06 2022] GET /identity/v3/role_assignments?user.id=46fa2a18bf5f49108e7df3a32506426e&scope.domain.id=default&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:06.611797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:06.632499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ce7212-2ce9-4314-bd35-61a5e8101b3c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:06.670255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a333eb5-5d06-480d-a673-aef7a7231d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:06.671072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a333eb5-5d06-480d-a673-aef7a7231d65 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:06.671364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a333eb5-5d06-480d-a673-aef7a7231d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:06.671653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a333eb5-5d06-480d-a673-aef7a7231d65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:06.673360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a333eb5-5d06-480d-a673-aef7a7231d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:06.674863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a333eb5-5d06-480d-a673-aef7a7231d65 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:06.676525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 29/56] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:06.682200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b97f6-730c-478b-987a-947c6bfb254f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:06.787050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b97f6-730c-478b-987a-947c6bfb254f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:06.811404 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:06.822170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d9dcca-fd0a-4e36-bd78-a39c24d16548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:06.822851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9dcca-fd0a-4e36-bd78-a39c24d16548 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:06.823147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9dcca-fd0a-4e36-bd78-a39c24d16548 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:06.823436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d9dcca-fd0a-4e36-bd78-a39c24d16548 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:06.824162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9dcca-fd0a-4e36-bd78-a39c24d16548 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:06.825619 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d9dcca-fd0a-4e36-bd78-a39c24d16548 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:06.903483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 28/57] 10.222.0.41 () {60 vars in 1140 bytes} [Thu May 26 12:23:06 2022] POST /identity/v3/projects => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:23:09.079683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474658-8a8b-4d4e-b96b-3cf5a5dadbbb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:09.080037 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474658-8a8b-4d4e-b96b-3cf5a5dadbbb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:09.080249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd474658-8a8b-4d4e-b96b-3cf5a5dadbbb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:09.081613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 30/58] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:09.086779 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5eef1-7137-4244-ba7d-975472b7db07 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:09.087179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5eef1-7137-4244-ba7d-975472b7db07 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:09.087354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5eef1-7137-4244-ba7d-975472b7db07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:09.103694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-16b5eef1-7137-4244-ba7d-975472b7db07 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:09.104889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-16b5eef1-7137-4244-ba7d-975472b7db07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:09.168963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 29/59] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:09.193179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474658-8a8b-4d4e-b96b-3cf5a5dadbbb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:09.290140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd474658-8a8b-4d4e-b96b-3cf5a5dadbbb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:09.322075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa1ccc3-57f5-4085-94a2-8fe24a32016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:09.322847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1ccc3-57f5-4085-94a2-8fe24a32016a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:09.323133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1ccc3-57f5-4085-94a2-8fe24a32016a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:09.323412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1ccc3-57f5-4085-94a2-8fe24a32016a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:09.324555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1ccc3-57f5-4085-94a2-8fe24a32016a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:09.326001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa1ccc3-57f5-4085-94a2-8fe24a32016a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:09.327587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 31/60] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:09.333496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5eef1-7137-4244-ba7d-975472b7db07 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:09.428242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5eef1-7137-4244-ba7d-975472b7db07 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:09.434757 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:09.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2392985-ff47-4bd6-a311-afd5f7b05301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:09.461247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2392985-ff47-4bd6-a311-afd5f7b05301 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:09.461539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2392985-ff47-4bd6-a311-afd5f7b05301 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:09.461854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2392985-ff47-4bd6-a311-afd5f7b05301 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:09.462573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2392985-ff47-4bd6-a311-afd5f7b05301 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:09.464016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2392985-ff47-4bd6-a311-afd5f7b05301 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:09.582686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 30/61] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:23:09 2022] POST /identity/v3/users => generated 275 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:12.850505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394c6c-5e62-4051-a635-f569a09ed088 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:12.851003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394c6c-5e62-4051-a635-f569a09ed088 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:12.851071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b394c6c-5e62-4051-a635-f569a09ed088 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:12.852449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 32/62] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:12.857980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddceee-69ca-44c4-8491-d69241aead6a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:12.858863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddceee-69ca-44c4-8491-d69241aead6a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:12.859345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddceee-69ca-44c4-8491-d69241aead6a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:12.861275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:12.862930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc349-506c-448a-b7b9-046cc8fe727b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:12.863425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc349-506c-448a-b7b9-046cc8fe727b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:12.863901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcc349-506c-448a-b7b9-046cc8fe727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:12.865853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc43c4-96e1-4e52-a2c4-357834f1f33a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:12.866346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc43c4-96e1-4e52-a2c4-357834f1f33a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:12.866856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc43c4-96e1-4e52-a2c4-357834f1f33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:12.892132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c1cc43c4-96e1-4e52-a2c4-357834f1f33a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:12.893654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c1cc43c4-96e1-4e52-a2c4-357834f1f33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:12.902671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7cbcc349-506c-448a-b7b9-046cc8fe727b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:12.903888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7cbcc349-506c-448a-b7b9-046cc8fe727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:12.920803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:13.000415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 33/64] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:13.023433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 32/65] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:13.035080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcc349-506c-448a-b7b9-046cc8fe727b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:13.059133 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc43c4-96e1-4e52-a2c4-357834f1f33a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:13.167776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcc349-506c-448a-b7b9-046cc8fe727b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:13.203220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f950ad-15cd-4756-b7bf-8f6f5c250a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:13.204783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f950ad-15cd-4756-b7bf-8f6f5c250a81 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.205361 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f950ad-15cd-4756-b7bf-8f6f5c250a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.205835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f950ad-15cd-4756-b7bf-8f6f5c250a81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.217345 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f950ad-15cd-4756-b7bf-8f6f5c250a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e9f950ad-15cd-4756-b7bf-8f6f5c250a81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:13.226752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:13.227655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:13.228394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:13.231254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 34/66] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:23:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:13.237471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f950ad-15cd-4756-b7bf-8f6f5c250a81 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:13.251528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:13.316544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:13.335840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc43c4-96e1-4e52-a2c4-357834f1f33a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:13.383075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eeb7cf-b66f-4fdb-a1ee-c6fa813c736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:13.384379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb7cf-b66f-4fdb-a1ee-c6fa813c736b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.385073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb7cf-b66f-4fdb-a1ee-c6fa813c736b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.385503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eeb7cf-b66f-4fdb-a1ee-c6fa813c736b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.395767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f950ad-15cd-4756-b7bf-8f6f5c250a81 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:13.400931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eeb7cf-b66f-4fdb-a1ee-c6fa813c736b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-18eeb7cf-b66f-4fdb-a1ee-c6fa813c736b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:13.412602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:13.413724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:13.414663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:13.417416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 33/67] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:13.419645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983b21-49ff-422c-95b9-9cac019ec76c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.420085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983b21-49ff-422c-95b9-9cac019ec76c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.420542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983b21-49ff-422c-95b9-9cac019ec76c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.422685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 34/68] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:13.423777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52983b21-49ff-422c-95b9-9cac019ec76c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:13.441769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c5134f-7aff-4712-ba1f-63a32154a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:13.442466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5134f-7aff-4712-ba1f-63a32154a520 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.442751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5134f-7aff-4712-ba1f-63a32154a520 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.443042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c5134f-7aff-4712-ba1f-63a32154a520 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.443821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5134f-7aff-4712-ba1f-63a32154a520 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:13.444137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5134f-7aff-4712-ba1f-63a32154a520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:13.445580 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c5134f-7aff-4712-ba1f-63a32154a520 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:13.455387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 35/69] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:13.456716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947657ee-cd56-4b61-9bab-1195da403fdb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.457012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947657ee-cd56-4b61-9bab-1195da403fdb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.457298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947657ee-cd56-4b61-9bab-1195da403fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.474102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-947657ee-cd56-4b61-9bab-1195da403fdb None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:13.475310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-947657ee-cd56-4b61-9bab-1195da403fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:13.537524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:13.542892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52983b21-49ff-422c-95b9-9cac019ec76c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:13.543253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 36/70] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:13.544822 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507a65f-f8ca-4812-8a6e-80aa486b1b87 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.545115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507a65f-f8ca-4812-8a6e-80aa486b1b87 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.545395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0507a65f-f8ca-4812-8a6e-80aa486b1b87 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.546878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 37/71] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:13.547625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507a65f-f8ca-4812-8a6e-80aa486b1b87 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:13.590911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835bc5a-1cdc-4d15-8c9c-17ab484ccc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:13.591591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835bc5a-1cdc-4d15-8c9c-17ab484ccc7c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.591890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835bc5a-1cdc-4d15-8c9c-17ab484ccc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.592174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835bc5a-1cdc-4d15-8c9c-17ab484ccc7c None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.592938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835bc5a-1cdc-4d15-8c9c-17ab484ccc7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:13.593257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835bc5a-1cdc-4d15-8c9c-17ab484ccc7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:13.594742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835bc5a-1cdc-4d15-8c9c-17ab484ccc7c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:13.604327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 35/72] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:13.605437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f8b6-7f76-4803-bb3a-d91c5c5bd6f9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.605760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f8b6-7f76-4803-bb3a-d91c5c5bd6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.606043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f8b6-7f76-4803-bb3a-d91c5c5bd6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.622452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4ed0f8b6-7f76-4803-bb3a-d91c5c5bd6f9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:13.623843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4ed0f8b6-7f76-4803-bb3a-d91c5c5bd6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:13.634151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:13.657362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0507a65f-f8ca-4812-8a6e-80aa486b1b87 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:13.689504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 36/73] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:13.692598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6763dc0-13eb-410b-816b-679611730b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:13.693471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6763dc0-13eb-410b-816b-679611730b63 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.693558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0f8b6-7f76-4803-bb3a-d91c5c5bd6f9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:13.693791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6763dc0-13eb-410b-816b-679611730b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.694189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6763dc0-13eb-410b-816b-679611730b63 None admin] PATH_INFO: `/v3/users/46fa2a18bf5f49108e7df3a32506426e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.695390 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6763dc0-13eb-410b-816b-679611730b63 None admin] RBAC: Authorizing `identity:get_user(user_id=46fa2a18bf5f49108e7df3a32506426e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:13.696867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6763dc0-13eb-410b-816b-679611730b63 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:13.698670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 38/74] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:13 2022] GET /identity/v3/users/46fa2a18bf5f49108e7df3a32506426e => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:13.699356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6763dc0-13eb-410b-816b-679611730b63 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:13.764487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:13.792802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0f8b6-7f76-4803-bb3a-d91c5c5bd6f9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:13.798131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6763dc0-13eb-410b-816b-679611730b63 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:13.830267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c183c-e2ba-4c62-a5cb-0b6d5133ee0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:13.831071 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c183c-e2ba-4c62-a5cb-0b6d5133ee0a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.831354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c183c-e2ba-4c62-a5cb-0b6d5133ee0a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.831629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64f4f0-cd29-4db3-97dd-072e7bb6ea7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:13.831730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c183c-e2ba-4c62-a5cb-0b6d5133ee0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.832496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64f4f0-cd29-4db3-97dd-072e7bb6ea7c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.832783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64f4f0-cd29-4db3-97dd-072e7bb6ea7c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.833064 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64f4f0-cd29-4db3-97dd-072e7bb6ea7c None admin] PATH_INFO: `/v3/users/41d518da297c4aae97a3c4c58f295974` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.841579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c183c-e2ba-4c62-a5cb-0b6d5133ee0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:13.847821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64f4f0-cd29-4db3-97dd-072e7bb6ea7c None admin] RBAC: Authorizing `identity:get_user(user_id=41d518da297c4aae97a3c4c58f295974)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:13.849264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64f4f0-cd29-4db3-97dd-072e7bb6ea7c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-262c183c-e2ba-4c62-a5cb-0b6d5133ee0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:13.849633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:13.850603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:13.851430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 37/75] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:13.852026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 39/76] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:13 2022] GET /identity/v3/users/41d518da297c4aae97a3c4c58f295974 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:13.852849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48f242-d542-4bf2-ad3f-3afce630dcaa None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:13.852938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64f4f0-cd29-4db3-97dd-072e7bb6ea7c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:13.853011 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48f242-d542-4bf2-ad3f-3afce630dcaa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:13.853011 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48f242-d542-4bf2-ad3f-3afce630dcaa None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:13.858026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 38/77] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:13.858026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48f242-d542-4bf2-ad3f-3afce630dcaa None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:13.861198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:13.969259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64f4f0-cd29-4db3-97dd-072e7bb6ea7c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:13.969490 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48f242-d542-4bf2-ad3f-3afce630dcaa None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:13.979996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:13.990675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90969b46-a4cd-4128-ad77-37e72130b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:14.004722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ac1f-187a-48c0-b655-f327e8d4215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:14.004871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969b46-a4cd-4128-ad77-37e72130b59b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:14.004871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969b46-a4cd-4128-ad77-37e72130b59b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:14.005036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ac1f-187a-48c0-b655-f327e8d4215e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:14.005120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90969b46-a4cd-4128-ad77-37e72130b59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:14.005198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ac1f-187a-48c0-b655-f327e8d4215e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:14.005198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2ac1f-187a-48c0-b655-f327e8d4215e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:14.005198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2ac1f-187a-48c0-b655-f327e8d4215e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:14.005198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2ac1f-187a-48c0-b655-f327e8d4215e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:14.005198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 39/78] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:14.005198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ac1f-187a-48c0-b655-f327e8d4215e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:14.060402 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90969b46-a4cd-4128-ad77-37e72130b59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:14.061893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90969b46-a4cd-4128-ad77-37e72130b59b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:14.070066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:14.101568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2ac1f-187a-48c0-b655-f327e8d4215e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:14.137298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267481b7-eca6-431f-aef6-dcb424e2416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:14.138009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267481b7-eca6-431f-aef6-dcb424e2416e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:14.138300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267481b7-eca6-431f-aef6-dcb424e2416e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:14.138587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267481b7-eca6-431f-aef6-dcb424e2416e None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:14.139336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267481b7-eca6-431f-aef6-dcb424e2416e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:14.139657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267481b7-eca6-431f-aef6-dcb424e2416e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:14.141060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267481b7-eca6-431f-aef6-dcb424e2416e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:14.148891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 40/79] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:14.149715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267481b7-eca6-431f-aef6-dcb424e2416e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:14.171177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 40/80] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:14.171177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b415-5139-401f-ab87-3b90c479a1b6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:14.171177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b415-5139-401f-ab87-3b90c479a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:14.171177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7b415-5139-401f-ab87-3b90c479a1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:14.187103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-dda7b415-5139-401f-ab87-3b90c479a1b6 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:14.188917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-dda7b415-5139-401f-ab87-3b90c479a1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:14.205703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:14.249397 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267481b7-eca6-431f-aef6-dcb424e2416e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:14.255015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 41/81] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:14.255935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7b415-5139-401f-ab87-3b90c479a1b6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:14.293094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7c9a-15a6-4c89-b719-e00ccfd5b2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:14.293779 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7c9a-15a6-4c89-b719-e00ccfd5b2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:14.294075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7c9a-15a6-4c89-b719-e00ccfd5b2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:14.294362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc7c9a-15a6-4c89-b719-e00ccfd5b2d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:14.297089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:14.354827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7b415-5139-401f-ab87-3b90c479a1b6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:14.363849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc7c9a-15a6-4c89-b719-e00ccfd5b2d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:14.365406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cc7c9a-15a6-4c89-b719-e00ccfd5b2d2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:14.388932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9106e-a861-4953-a612-6920d8cfc59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:14.389599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9106e-a861-4953-a612-6920d8cfc59d None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:14.389932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9106e-a861-4953-a612-6920d8cfc59d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:14.390217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9106e-a861-4953-a612-6920d8cfc59d None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:14.390917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9106e-a861-4953-a612-6920d8cfc59d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:14.392988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9106e-a861-4953-a612-6920d8cfc59d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:14.464161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 41/82] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:14.465003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7c9a-15a6-4c89-b719-e00ccfd5b2d2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:14.497083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:14.508454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 42/83] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:23:14 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:14.508454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9106e-a861-4953-a612-6920d8cfc59d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:14.519912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:14.584912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc7c9a-15a6-4c89-b719-e00ccfd5b2d2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:14.620454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9106e-a861-4953-a612-6920d8cfc59d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:14.626301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133d27-cd3e-4830-b3d4-6d44899eddef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:14.627205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133d27-cd3e-4830-b3d4-6d44899eddef None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:14.627494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133d27-cd3e-4830-b3d4-6d44899eddef None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:14.627774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26133d27-cd3e-4830-b3d4-6d44899eddef None admin] PATH_INFO: `/v3/users/41d518da297c4aae97a3c4c58f295974` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:14.629024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26133d27-cd3e-4830-b3d4-6d44899eddef None admin] RBAC: Authorizing `identity:get_user(user_id=41d518da297c4aae97a3c4c58f295974)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:14.631095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26133d27-cd3e-4830-b3d4-6d44899eddef None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:14.633785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 42/84] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:14 2022] GET /identity/v3/users/41d518da297c4aae97a3c4c58f295974 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:14.638589 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133d27-cd3e-4830-b3d4-6d44899eddef None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:14.664846 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08288d3a-05f4-4f8f-9ffe-df2893ea5754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:14.666086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08288d3a-05f4-4f8f-9ffe-df2893ea5754 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:14.666382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08288d3a-05f4-4f8f-9ffe-df2893ea5754 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:14.666667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08288d3a-05f4-4f8f-9ffe-df2893ea5754 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:14.667972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08288d3a-05f4-4f8f-9ffe-df2893ea5754 None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:14.669441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08288d3a-05f4-4f8f-9ffe-df2893ea5754 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:14.671238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 43/85] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:14 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:14.677445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08288d3a-05f4-4f8f-9ffe-df2893ea5754 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:14.754304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26133d27-cd3e-4830-b3d4-6d44899eddef None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:14.756059 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:14.774243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:14.796013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927703be-c19e-456d-957e-8325dbd34ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:14.796826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927703be-c19e-456d-957e-8325dbd34ddc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:14.797118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927703be-c19e-456d-957e-8325dbd34ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:14.797424 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927703be-c19e-456d-957e-8325dbd34ddc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:14.806783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08288d3a-05f4-4f8f-9ffe-df2893ea5754 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:14.822203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927703be-c19e-456d-957e-8325dbd34ddc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-927703be-c19e-456d-957e-8325dbd34ddc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:14.830614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:14.831485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 43/86] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:14.832623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927703be-c19e-456d-957e-8325dbd34ddc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:14.857788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3064a7-4b65-4bce-a47b-6aeb139d05bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:14.858831 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3064a7-4b65-4bce-a47b-6aeb139d05bc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:14.859238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3064a7-4b65-4bce-a47b-6aeb139d05bc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:14.859523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3064a7-4b65-4bce-a47b-6aeb139d05bc None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:14.860747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3064a7-4b65-4bce-a47b-6aeb139d05bc None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:14.862429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3064a7-4b65-4bce-a47b-6aeb139d05bc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:14.864142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 44/87] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:14 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:14.865017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3064a7-4b65-4bce-a47b-6aeb139d05bc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:14.966378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927703be-c19e-456d-957e-8325dbd34ddc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:14.995168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3064a7-4b65-4bce-a47b-6aeb139d05bc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:15.003200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bbe45-0ec6-45db-abcb-3ff1b68a57ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:15.004120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bbe45-0ec6-45db-abcb-3ff1b68a57ac None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:15.004593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bbe45-0ec6-45db-abcb-3ff1b68a57ac None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:15.005134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bbe45-0ec6-45db-abcb-3ff1b68a57ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:15.037639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:15.041234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c52990-2d88-47f0-8372-de26e803a585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:15.042038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52990-2d88-47f0-8372-de26e803a585 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:15.042431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52990-2d88-47f0-8372-de26e803a585 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:15.042875 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c52990-2d88-47f0-8372-de26e803a585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:15.044738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c52990-2d88-47f0-8372-de26e803a585 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14, user.id=46fa2a18bf5f49108e7df3a32506426e) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:15.045132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c52990-2d88-47f0-8372-de26e803a585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:15.046639 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c52990-2d88-47f0-8372-de26e803a585 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:15.057173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 45/88] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:14 2022] GET /identity/v3/role_assignments?user.id=46fa2a18bf5f49108e7df3a32506426e&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:15.058397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c52990-2d88-47f0-8372-de26e803a585 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:15.077562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:15.095279 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bbe45-0ec6-45db-abcb-3ff1b68a57ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:15.097088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bbe45-0ec6-45db-abcb-3ff1b68a57ac None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:15.181375 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c52990-2d88-47f0-8372-de26e803a585 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:15.218654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa9aab-bb6c-42db-a0e3-3b72ed278938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:15.219437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa9aab-bb6c-42db-a0e3-3b72ed278938 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:15.219733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa9aab-bb6c-42db-a0e3-3b72ed278938 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:15.220053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa9aab-bb6c-42db-a0e3-3b72ed278938 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:15.220778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa9aab-bb6c-42db-a0e3-3b72ed278938 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:15.221112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa9aab-bb6c-42db-a0e3-3b72ed278938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:15.222511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfa9aab-bb6c-42db-a0e3-3b72ed278938 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:15.228562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 44/89] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:15.229903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bbe45-0ec6-45db-abcb-3ff1b68a57ac None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:15.231755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 46/90] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:15.237477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa9aab-bb6c-42db-a0e3-3b72ed278938 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:15.299565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:15.333821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:15.343462 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bbe45-0ec6-45db-abcb-3ff1b68a57ac None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:15.359032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa9aab-bb6c-42db-a0e3-3b72ed278938 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:15.414689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833d29f-9e32-432f-ab06-62082f541078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:15.415367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833d29f-9e32-432f-ab06-62082f541078 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:15.415663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833d29f-9e32-432f-ab06-62082f541078 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:15.415949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833d29f-9e32-432f-ab06-62082f541078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:15.416800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833d29f-9e32-432f-ab06-62082f541078 None admin] RBAC: Adding query filter params (role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14, user.id=41d518da297c4aae97a3c4c58f295974) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:15.417127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833d29f-9e32-432f-ab06-62082f541078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:15.418649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9833d29f-9e32-432f-ab06-62082f541078 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:15.429924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974eb68-2537-44a7-9369-fa76d91aaf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:15.430797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974eb68-2537-44a7-9369-fa76d91aaf8e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:15.431091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974eb68-2537-44a7-9369-fa76d91aaf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:15.431378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974eb68-2537-44a7-9369-fa76d91aaf8e None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:15.434767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 45/91] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:15 2022] GET /identity/v3/role_assignments?user.id=41d518da297c4aae97a3c4c58f295974&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:15.435655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974eb68-2537-44a7-9369-fa76d91aaf8e None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:15.436548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833d29f-9e32-432f-ab06-62082f541078 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:15.439002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974eb68-2537-44a7-9369-fa76d91aaf8e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:15.440847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 47/92] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:15 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:15.451237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974eb68-2537-44a7-9369-fa76d91aaf8e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:15.635925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974eb68-2537-44a7-9369-fa76d91aaf8e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:15.688083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833d29f-9e32-432f-ab06-62082f541078 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:15.742330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e3893-dc86-4101-a7a0-4649d3dc4433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:15.743264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e3893-dc86-4101-a7a0-4649d3dc4433 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:15.743714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e3893-dc86-4101-a7a0-4649d3dc4433 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:15.744136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:15.745290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e3893-dc86-4101-a7a0-4649d3dc4433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:15.746499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e3893-dc86-4101-a7a0-4649d3dc4433 None admin] RBAC: Adding query filter params (role.id=af99020fdd8b4a4e93e3b913d49e9cf8, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14, user.id=41d518da297c4aae97a3c4c58f295974) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:15.747271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e3893-dc86-4101-a7a0-4649d3dc4433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:15.748943 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e3893-dc86-4101-a7a0-4649d3dc4433 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:15.756911 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 48/93] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:15 2022] GET /identity/v3/role_assignments?user.id=41d518da297c4aae97a3c4c58f295974&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=af99020fdd8b4a4e93e3b913d49e9cf8 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:15.762469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b2e1d-fd95-4f9f-84fe-d164e43adc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:15.762469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b2e1d-fd95-4f9f-84fe-d164e43adc67 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:15.762469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b2e1d-fd95-4f9f-84fe-d164e43adc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:15.762469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b2e1d-fd95-4f9f-84fe-d164e43adc67 None admin] PATH_INFO: `/v3/users/41d518da297c4aae97a3c4c58f295974` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:15.763478 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b2e1d-fd95-4f9f-84fe-d164e43adc67 None admin] RBAC: Authorizing `identity:get_user(user_id=41d518da297c4aae97a3c4c58f295974)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:15.765118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b2e1d-fd95-4f9f-84fe-d164e43adc67 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:15.767048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 46/94] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:15 2022] GET /identity/v3/users/41d518da297c4aae97a3c4c58f295974 => generated 275 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:15.772695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e3893-dc86-4101-a7a0-4649d3dc4433 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:15.777999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:15.958503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e3893-dc86-4101-a7a0-4649d3dc4433 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:16.008136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a5a05-dc7d-43dd-94f3-75280a40e62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:16.008808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5a05-dc7d-43dd-94f3-75280a40e62c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:16.009103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5a05-dc7d-43dd-94f3-75280a40e62c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:16.009385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a5a05-dc7d-43dd-94f3-75280a40e62c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:16.129587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a5a05-dc7d-43dd-94f3-75280a40e62c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:16.131092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a5a05-dc7d-43dd-94f3-75280a40e62c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:16.136953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:16.264128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 49/95] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:16.270307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b2e1d-fd95-4f9f-84fe-d164e43adc67 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:16.390440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b2e1d-fd95-4f9f-84fe-d164e43adc67 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:16.428823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ff08d0-2802-41c2-81a5-8e8527caee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:16.429724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff08d0-2802-41c2-81a5-8e8527caee98 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:16.430018 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff08d0-2802-41c2-81a5-8e8527caee98 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:16.430299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ff08d0-2802-41c2-81a5-8e8527caee98 None admin] PATH_INFO: `/v3/projects/8201df35ff52430a8d1a36841fa74018` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:16.431510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff08d0-2802-41c2-81a5-8e8527caee98 None admin] RBAC: Authorizing `identity:get_project(project_id=8201df35ff52430a8d1a36841fa74018)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:16.432960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ff08d0-2802-41c2-81a5-8e8527caee98 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:16.434675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 47/96] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:16 2022] GET /identity/v3/projects/8201df35ff52430a8d1a36841fa74018 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:16.441416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a5a05-dc7d-43dd-94f3-75280a40e62c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:16.572442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a5a05-dc7d-43dd-94f3-75280a40e62c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:16.575241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:16.610420 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297cedf-ecc7-45b5-90d1-82342eb6c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:16.612392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297cedf-ecc7-45b5-90d1-82342eb6c96a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:16.612893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297cedf-ecc7-45b5-90d1-82342eb6c96a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:16.613373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297cedf-ecc7-45b5-90d1-82342eb6c96a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:16.614566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297cedf-ecc7-45b5-90d1-82342eb6c96a None admin] RBAC: Adding query filter params (role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, scope.project.id=8201df35ff52430a8d1a36841fa74018, user.id=41d518da297c4aae97a3c4c58f295974) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:16.618806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297cedf-ecc7-45b5-90d1-82342eb6c96a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:16.618806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297cedf-ecc7-45b5-90d1-82342eb6c96a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:16.623386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 50/97] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:16 2022] GET /identity/v3/role_assignments?user.id=41d518da297c4aae97a3c4c58f295974&scope.project.id=8201df35ff52430a8d1a36841fa74018&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:17.241542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cc5e9-f86f-4c96-afb3-c5987a01ea17 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:17.241951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cc5e9-f86f-4c96-afb3-c5987a01ea17 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:17.242158 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cc5e9-f86f-4c96-afb3-c5987a01ea17 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:17.243827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 48/98] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:17.249863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4f38-9b1c-46a1-94d0-e5a9f573075d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:17.250926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4f38-9b1c-46a1-94d0-e5a9f573075d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:17.251010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4f38-9b1c-46a1-94d0-e5a9f573075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:17.272787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-eccb4f38-9b1c-46a1-94d0-e5a9f573075d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:17.274018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-eccb4f38-9b1c-46a1-94d0-e5a9f573075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:17.368273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 51/99] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:17.416218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cc5e9-f86f-4c96-afb3-c5987a01ea17 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:17.490188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:17.530309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cc5e9-f86f-4c96-afb3-c5987a01ea17 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:17.565866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74509eaf-68e5-45a6-b256-76ecf341ec4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:17.566655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74509eaf-68e5-45a6-b256-76ecf341ec4b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:17.566942 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74509eaf-68e5-45a6-b256-76ecf341ec4b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:17.567220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74509eaf-68e5-45a6-b256-76ecf341ec4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:17.568379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74509eaf-68e5-45a6-b256-76ecf341ec4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:17.569854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74509eaf-68e5-45a6-b256-76ecf341ec4b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:17.571459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 49/100] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:17.576957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb4f38-9b1c-46a1-94d0-e5a9f573075d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:17.697514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:17.702123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb4f38-9b1c-46a1-94d0-e5a9f573075d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:17.738536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40af11-65b1-48b0-9345-4d1ed8e62cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:17.739209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40af11-65b1-48b0-9345-4d1ed8e62cd5 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:17.739490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40af11-65b1-48b0-9345-4d1ed8e62cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:17.739910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40af11-65b1-48b0-9345-4d1ed8e62cd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:17.740488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40af11-65b1-48b0-9345-4d1ed8e62cd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:17.742897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496d095-14f8-45ce-8016-eda1c24fe240 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:17.743115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496d095-14f8-45ce-8016-eda1c24fe240 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:17.743394 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496d095-14f8-45ce-8016-eda1c24fe240 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:17.744818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 50/101] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:17.745886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40af11-65b1-48b0-9345-4d1ed8e62cd5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:17.759440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994842-6648-45df-aebe-986d44edec61 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:17.759708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994842-6648-45df-aebe-986d44edec61 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:17.759996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994842-6648-45df-aebe-986d44edec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:17.782679 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-74994842-6648-45df-aebe-986d44edec61 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:17.783862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-74994842-6648-45df-aebe-986d44edec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:17.857083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 51/102] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:17.863413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 52/103] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:23:17 2022] POST /identity/v3/projects => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:17.914127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994842-6648-45df-aebe-986d44edec61 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:17.997874 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:18.056004 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994842-6648-45df-aebe-986d44edec61 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:18.105033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b2f0b-bc20-4f8d-b266-aa0faa95ac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:18.105886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b2f0b-bc20-4f8d-b266-aa0faa95ac17 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:18.106178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b2f0b-bc20-4f8d-b266-aa0faa95ac17 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:18.106458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36b2f0b-bc20-4f8d-b266-aa0faa95ac17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:18.127714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36b2f0b-bc20-4f8d-b266-aa0faa95ac17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c36b2f0b-bc20-4f8d-b266-aa0faa95ac17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:18.135698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:18.136551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:18.137292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 52/104] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:18.144668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40af11-65b1-48b0-9345-4d1ed8e62cd5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:18.286983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40af11-65b1-48b0-9345-4d1ed8e62cd5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:18.325249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728acc58-b833-49a0-a570-bf48520b4fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:18.326306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728acc58-b833-49a0-a570-bf48520b4fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:18.326802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728acc58-b833-49a0-a570-bf48520b4fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:18.327326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728acc58-b833-49a0-a570-bf48520b4fc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:18.328313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728acc58-b833-49a0-a570-bf48520b4fc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:18.329348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728acc58-b833-49a0-a570-bf48520b4fc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:18.330982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728acc58-b833-49a0-a570-bf48520b4fc6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:18.339905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 53/105] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:18.346015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b2f0b-bc20-4f8d-b266-aa0faa95ac17 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:18.461838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36b2f0b-bc20-4f8d-b266-aa0faa95ac17 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:18.483691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:18.499579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8da0a-d909-4803-9c80-f3330c5798ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:18.501284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8da0a-d909-4803-9c80-f3330c5798ad None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:18.502151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8da0a-d909-4803-9c80-f3330c5798ad None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:18.502663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8da0a-d909-4803-9c80-f3330c5798ad None admin] PATH_INFO: `/v3/users/edef234764cd4cee94a25f79c1acebb0` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:18.522887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8da0a-d909-4803-9c80-f3330c5798ad None admin] RBAC: Authorizing `identity:get_user(user_id=edef234764cd4cee94a25f79c1acebb0)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:18.524685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8da0a-d909-4803-9c80-f3330c5798ad None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:18.526653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 53/106] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:18 2022] GET /identity/v3/users/edef234764cd4cee94a25f79c1acebb0 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:18.532327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f68b-ba1a-4863-b721-40cb9b38bb2c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:18.533131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f68b-ba1a-4863-b721-40cb9b38bb2c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:18.533632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917f68b-ba1a-4863-b721-40cb9b38bb2c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:18.535325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 54/107] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:18.536371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8da0a-d909-4803-9c80-f3330c5798ad None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:18.555301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac6f2-87f4-4d75-b3b9-6f68c4c04a67 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:18.555900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac6f2-87f4-4d75-b3b9-6f68c4c04a67 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:18.556384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ac6f2-87f4-4d75-b3b9-6f68c4c04a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:18.581017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ef8ac6f2-87f4-4d75-b3b9-6f68c4c04a67 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:18.583558 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ef8ac6f2-87f4-4d75-b3b9-6f68c4c04a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:18.597937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:18.686266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 55/108] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 26 12:23:18.687631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2ea20-53bc-49e9-a0dd-85297ebed0f4 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:18.688462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2ea20-53bc-49e9-a0dd-85297ebed0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:18.688753 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2ea20-53bc-49e9-a0dd-85297ebed0f4 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:18.690400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 56/109] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:18.699202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64eb1-557b-438e-b4e5-27e3d540c103 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:18.699493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64eb1-557b-438e-b4e5-27e3d540c103 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:18.699773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e64eb1-557b-438e-b4e5-27e3d540c103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:18.732377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d1e64eb1-557b-438e-b4e5-27e3d540c103 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:18.734345 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d1e64eb1-557b-438e-b4e5-27e3d540c103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:18.739060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8da0a-d909-4803-9c80-f3330c5798ad None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:18.800314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0ed40-3e34-4cfe-9696-d9a1a9084166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:18.800974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ed40-3e34-4cfe-9696-d9a1a9084166 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:18.801260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ed40-3e34-4cfe-9696-d9a1a9084166 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:18.801541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c0ed40-3e34-4cfe-9696-d9a1a9084166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:18.861834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 57/110] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:18.862531 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64eb1-557b-438e-b4e5-27e3d540c103 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:18.893151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:18.927517 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0ed40-3e34-4cfe-9696-d9a1a9084166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:18.929025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c0ed40-3e34-4cfe-9696-d9a1a9084166 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:18.982171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:19.015753 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e64eb1-557b-438e-b4e5-27e3d540c103 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:19.068814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838011f-324c-48d4-b120-f109419c89a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:19.069739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838011f-324c-48d4-b120-f109419c89a9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.070043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838011f-324c-48d4-b120-f109419c89a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.070328 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1838011f-324c-48d4-b120-f109419c89a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.114403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1838011f-324c-48d4-b120-f109419c89a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:19.115782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 54/111] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:19.116829 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0ed40-3e34-4cfe-9696-d9a1a9084166 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-1838011f-324c-48d4-b120-f109419c89a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:19.122486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:19.123319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:19.124036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:19.130655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 58/112] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:23:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:19.131125 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838011f-324c-48d4-b120-f109419c89a9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:19.217572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:19.231133 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c0ed40-3e34-4cfe-9696-d9a1a9084166 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:19.275392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b845f23-143b-410e-9e2c-1549e4b94eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:19.276630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b845f23-143b-410e-9e2c-1549e4b94eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b845f23-143b-410e-9e2c-1549e4b94eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.277715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b845f23-143b-410e-9e2c-1549e4b94eb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.301903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b845f23-143b-410e-9e2c-1549e4b94eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:19.316501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1838011f-324c-48d4-b120-f109419c89a9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-3b845f23-143b-410e-9e2c-1549e4b94eb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:19.321027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:19.321858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:19.322603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:19.324990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 55/113] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:19.330965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b845f23-143b-410e-9e2c-1549e4b94eb1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:19.369464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb93e0-45b5-4019-912e-044d25f618e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:19.372995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:19.374889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb93e0-45b5-4019-912e-044d25f618e3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.375201 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb93e0-45b5-4019-912e-044d25f618e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.375682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb93e0-45b5-4019-912e-044d25f618e3 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.376899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb93e0-45b5-4019-912e-044d25f618e3 None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:19.378534 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb93e0-45b5-4019-912e-044d25f618e3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:19.380470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 59/114] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:19.384095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb93e0-45b5-4019-912e-044d25f618e3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:19.518510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb93e0-45b5-4019-912e-044d25f618e3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:19.529367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b845f23-143b-410e-9e2c-1549e4b94eb1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:19.553364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cd000-5062-425f-824a-b2157f15a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:19.554077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cd000-5062-425f-824a-b2157f15a9eb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.554383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cd000-5062-425f-824a-b2157f15a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.554650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cd000-5062-425f-824a-b2157f15a9eb None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.555414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cd000-5062-425f-824a-b2157f15a9eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:19.555725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cd000-5062-425f-824a-b2157f15a9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:19.557109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cd000-5062-425f-824a-b2157f15a9eb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:19.566290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 60/115] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:19.566918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cd000-5062-425f-824a-b2157f15a9eb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:19.567760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6353f3-6e87-498d-89f4-ca68a5d15900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:19.568445 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6353f3-6e87-498d-89f4-ca68a5d15900 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.568738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6353f3-6e87-498d-89f4-ca68a5d15900 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.569021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6353f3-6e87-498d-89f4-ca68a5d15900 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.570148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6353f3-6e87-498d-89f4-ca68a5d15900 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:19.571424 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6353f3-6e87-498d-89f4-ca68a5d15900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:19.572926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6353f3-6e87-498d-89f4-ca68a5d15900 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:19.584089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 56/116] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:19.590482 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0048c-4a77-4260-823e-063cb6028146 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.590793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0048c-4a77-4260-823e-063cb6028146 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.591181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0048c-4a77-4260-823e-063cb6028146 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.592758 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 57/117] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:19.593809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0048c-4a77-4260-823e-063cb6028146 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:19.628237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:19.636786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:19.687208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cd000-5062-425f-824a-b2157f15a9eb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:19.722517 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0048c-4a77-4260-823e-063cb6028146 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:19.723484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79a0e9-fa01-48b9-b90c-228097c289bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:19.724278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a0e9-fa01-48b9-b90c-228097c289bc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.724661 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a0e9-fa01-48b9-b90c-228097c289bc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.725017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79a0e9-fa01-48b9-b90c-228097c289bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.725985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79a0e9-fa01-48b9-b90c-228097c289bc None admin] RBAC: Adding query filter params (role.id=35bddef47fa34f62be6f49ddad1b12aa, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14, user.id=edef234764cd4cee94a25f79c1acebb0) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:19.726413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79a0e9-fa01-48b9-b90c-228097c289bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:19.728011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79a0e9-fa01-48b9-b90c-228097c289bc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:19.734048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 61/118] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/role_assignments?user.id=edef234764cd4cee94a25f79c1acebb0&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=35bddef47fa34f62be6f49ddad1b12aa => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:19.734991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79a0e9-fa01-48b9-b90c-228097c289bc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:19.763623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbfad7-73ac-4ea0-a510-54eccd4b49a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:19.764564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbfad7-73ac-4ea0-a510-54eccd4b49a8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.764904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbfad7-73ac-4ea0-a510-54eccd4b49a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.765193 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbfad7-73ac-4ea0-a510-54eccd4b49a8 None admin] PATH_INFO: `/v3/users/41d518da297c4aae97a3c4c58f295974` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.767187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbfad7-73ac-4ea0-a510-54eccd4b49a8 None admin] RBAC: Authorizing `identity:get_user(user_id=41d518da297c4aae97a3c4c58f295974)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:19.768748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbfad7-73ac-4ea0-a510-54eccd4b49a8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:19.770577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 58/119] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/users/41d518da297c4aae97a3c4c58f295974 => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:19.772030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ccfde-2018-4897-a952-06e1515c7751 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.772326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ccfde-2018-4897-a952-06e1515c7751 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.772615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ccfde-2018-4897-a952-06e1515c7751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.792227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e26ccfde-2018-4897-a952-06e1515c7751 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:19.800053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e26ccfde-2018-4897-a952-06e1515c7751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:19.843822 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79a0e9-fa01-48b9-b90c-228097c289bc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:19.864377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:19.871042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 59/120] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:19.878782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ccfde-2018-4897-a952-06e1515c7751 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:19.879119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:19.882753 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1ba17-ce33-4549-a0d8-45ad401e37c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:19.883742 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1ba17-ce33-4549-a0d8-45ad401e37c3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:19.884040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1ba17-ce33-4549-a0d8-45ad401e37c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:19.884324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1ba17-ce33-4549-a0d8-45ad401e37c3 None admin] PATH_INFO: `/v3/users/46fa2a18bf5f49108e7df3a32506426e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:19.885536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1ba17-ce33-4549-a0d8-45ad401e37c3 None admin] RBAC: Authorizing `identity:get_user(user_id=46fa2a18bf5f49108e7df3a32506426e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:19.887107 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1ba17-ce33-4549-a0d8-45ad401e37c3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:19.888824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 62/121] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/users/46fa2a18bf5f49108e7df3a32506426e => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:19.894286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1ba17-ce33-4549-a0d8-45ad401e37c3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:20.005457 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ccfde-2018-4897-a952-06e1515c7751 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:20.043874 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8897b-8793-43ed-b5d8-d018b50fc698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:20.044756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8897b-8793-43ed-b5d8-d018b50fc698 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:20.045046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8897b-8793-43ed-b5d8-d018b50fc698 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:20.045226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1ba17-ce33-4549-a0d8-45ad401e37c3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:20.045377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8897b-8793-43ed-b5d8-d018b50fc698 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:20.046722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8897b-8793-43ed-b5d8-d018b50fc698 None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:20.048781 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8897b-8793-43ed-b5d8-d018b50fc698 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:20.050778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 60/122] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:20.051407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8897b-8793-43ed-b5d8-d018b50fc698 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:20.108455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1440b-0f7b-4018-bf41-782fad83627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:20.109350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1440b-0f7b-4018-bf41-782fad83627c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:20.109641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1440b-0f7b-4018-bf41-782fad83627c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:20.110492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1440b-0f7b-4018-bf41-782fad83627c None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:20.117406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1440b-0f7b-4018-bf41-782fad83627c None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:20.118928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1440b-0f7b-4018-bf41-782fad83627c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:20.125141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 63/123] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:19 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:20.126652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1440b-0f7b-4018-bf41-782fad83627c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:20.175281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:20.231259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8897b-8793-43ed-b5d8-d018b50fc698 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:20.236957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:20.270000 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd878e0e-54d3-472d-9da2-482521e3bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:20.271552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd878e0e-54d3-472d-9da2-482521e3bec8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:20.272262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd878e0e-54d3-472d-9da2-482521e3bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:20.272691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd878e0e-54d3-472d-9da2-482521e3bec8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:20.277559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1440b-0f7b-4018-bf41-782fad83627c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:20.287719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd878e0e-54d3-472d-9da2-482521e3bec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-cd878e0e-54d3-472d-9da2-482521e3bec8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:20.296670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:20.298294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:20.299225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:20.301102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 61/124] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:20.302046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd878e0e-54d3-472d-9da2-482521e3bec8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:20.323315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fb101-ed22-405a-b83f-445b3500b85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:20.324215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fb101-ed22-405a-b83f-445b3500b85e None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:20.324502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fb101-ed22-405a-b83f-445b3500b85e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:20.324780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fb101-ed22-405a-b83f-445b3500b85e None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/users/41d518da297c4aae97a3c4c58f295974/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:20.326827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fb101-ed22-405a-b83f-445b3500b85e None admin] RBAC: Authorizing `identity:create_grant(project_id=058eb95aa34c4eed9a28c8cee87c0c14, user_id=41d518da297c4aae97a3c4c58f295974, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:20.329422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fb101-ed22-405a-b83f-445b3500b85e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:20.410368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 64/125] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:23:20 2022] PUT /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/users/41d518da297c4aae97a3c4c58f295974/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:20.410985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd878e0e-54d3-472d-9da2-482521e3bec8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:20.411864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5103181-068b-4507-835d-b13c5bb7a8c8 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:20.412170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5103181-068b-4507-835d-b13c5bb7a8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:20.412458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5103181-068b-4507-835d-b13c5bb7a8c8 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:20.417789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 65/126] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:20.417789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5103181-068b-4507-835d-b13c5bb7a8c8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:20.471929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:20.492470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c90a0-1649-424a-81f4-c4cca609a81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:20.493501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c90a0-1649-424a-81f4-c4cca609a81c None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:20.493832 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c90a0-1649-424a-81f4-c4cca609a81c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:20.494119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c90a0-1649-424a-81f4-c4cca609a81c None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/users/46fa2a18bf5f49108e7df3a32506426e/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:20.501605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c90a0-1649-424a-81f4-c4cca609a81c None admin] RBAC: Authorizing `identity:create_grant(project_id=058eb95aa34c4eed9a28c8cee87c0c14, user_id=46fa2a18bf5f49108e7df3a32506426e, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:20.503147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c90a0-1649-424a-81f4-c4cca609a81c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:20.548831 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5103181-068b-4507-835d-b13c5bb7a8c8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:20.574980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:20.587706 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 62/127] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:23:20 2022] PUT /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/users/46fa2a18bf5f49108e7df3a32506426e/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:20.588988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40f9b4-4607-4ab8-8214-fcdbee78d11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:20.589112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cc031-893a-4dde-9948-5f1e1e7fc73c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:20.589375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cc031-893a-4dde-9948-5f1e1e7fc73c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:20.589747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40f9b4-4607-4ab8-8214-fcdbee78d11d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:20.590047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40f9b4-4607-4ab8-8214-fcdbee78d11d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:20.590332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40f9b4-4607-4ab8-8214-fcdbee78d11d None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:20.591162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40f9b4-4607-4ab8-8214-fcdbee78d11d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:20.591521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40f9b4-4607-4ab8-8214-fcdbee78d11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:20.592988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40f9b4-4607-4ab8-8214-fcdbee78d11d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:20.597856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cc031-893a-4dde-9948-5f1e1e7fc73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:20.604296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 66/128] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:20.610962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40f9b4-4607-4ab8-8214-fcdbee78d11d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:20.632400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c48cc031-893a-4dde-9948-5f1e1e7fc73c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:20.633130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c48cc031-893a-4dde-9948-5f1e1e7fc73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:20.783080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 63/129] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:20.798598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40f9b4-4607-4ab8-8214-fcdbee78d11d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:20.844954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99263d-8ff0-42eb-9dd8-70777a0cba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:20.846203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99263d-8ff0-42eb-9dd8-70777a0cba03 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:20.846711 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99263d-8ff0-42eb-9dd8-70777a0cba03 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:20.847183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99263d-8ff0-42eb-9dd8-70777a0cba03 None admin] PATH_INFO: `/v3/users/41d518da297c4aae97a3c4c58f295974` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:20.848585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99263d-8ff0-42eb-9dd8-70777a0cba03 None admin] RBAC: Authorizing `identity:get_user(user_id=41d518da297c4aae97a3c4c58f295974)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:20.850277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99263d-8ff0-42eb-9dd8-70777a0cba03 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:20.852504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 67/130] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:20 2022] GET /identity/v3/users/41d518da297c4aae97a3c4c58f295974 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:20.857653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cc031-893a-4dde-9948-5f1e1e7fc73c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:20.883069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99263d-8ff0-42eb-9dd8-70777a0cba03 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:20.975320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48cc031-893a-4dde-9948-5f1e1e7fc73c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:20.990396 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:20.996466 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:21.031295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519c3c5-a3b7-470e-b8ac-009bcc58efa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:21.032282 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c3c5-a3b7-470e-b8ac-009bcc58efa8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.032577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c3c5-a3b7-470e-b8ac-009bcc58efa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.032864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c3c5-a3b7-470e-b8ac-009bcc58efa8 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.038555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519c3c5-a3b7-470e-b8ac-009bcc58efa8 None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:21.040332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519c3c5-a3b7-470e-b8ac-009bcc58efa8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:21.042811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 64/131] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:20 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:21.044326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7d849-d3cf-4852-8c97-c453ac978632 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.044812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7d849-d3cf-4852-8c97-c453ac978632 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.045604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7d849-d3cf-4852-8c97-c453ac978632 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.047269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 65/132] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:21.054206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7d849-d3cf-4852-8c97-c453ac978632 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:21.090966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99263d-8ff0-42eb-9dd8-70777a0cba03 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:21.149700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4189c58-357a-4a75-8787-6285158c30e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:21.149700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189c58-357a-4a75-8787-6285158c30e2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.149700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189c58-357a-4a75-8787-6285158c30e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.149700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4189c58-357a-4a75-8787-6285158c30e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.155582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4189c58-357a-4a75-8787-6285158c30e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f4189c58-357a-4a75-8787-6285158c30e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:21.164115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:21.165012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:21.165843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:21.166430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 68/133] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:21.170002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d59d4-477a-45f4-896a-eede1a7bda06 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.170002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d59d4-477a-45f4-896a-eede1a7bda06 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.170002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d59d4-477a-45f4-896a-eede1a7bda06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.185612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e23d59d4-477a-45f4-896a-eede1a7bda06 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:21.186886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e23d59d4-477a-45f4-896a-eede1a7bda06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:21.259707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 69/134] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:21.260633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d59d4-477a-45f4-896a-eede1a7bda06 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:21.273934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7d849-d3cf-4852-8c97-c453ac978632 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:21.314255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:21.352054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805767dd-7a8f-4ab2-bfa5-7eb9f535a8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:21.354179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805767dd-7a8f-4ab2-bfa5-7eb9f535a8be None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.354472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805767dd-7a8f-4ab2-bfa5-7eb9f535a8be None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.354761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805767dd-7a8f-4ab2-bfa5-7eb9f535a8be None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/users/41d518da297c4aae97a3c4c58f295974/roles/af99020fdd8b4a4e93e3b913d49e9cf8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.360435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805767dd-7a8f-4ab2-bfa5-7eb9f535a8be None admin] RBAC: Authorizing `identity:create_grant(project_id=058eb95aa34c4eed9a28c8cee87c0c14, user_id=41d518da297c4aae97a3c4c58f295974, role_id=af99020fdd8b4a4e93e3b913d49e9cf8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:21.364362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805767dd-7a8f-4ab2-bfa5-7eb9f535a8be None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:21.396238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d59d4-477a-45f4-896a-eede1a7bda06 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:21.432669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cab5ff-af44-4c30-8277-728540f2ccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:21.433408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cab5ff-af44-4c30-8277-728540f2ccb9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.433722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cab5ff-af44-4c30-8277-728540f2ccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.434016 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cab5ff-af44-4c30-8277-728540f2ccb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.434778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cab5ff-af44-4c30-8277-728540f2ccb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:21.435145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cab5ff-af44-4c30-8277-728540f2ccb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:21.436541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cab5ff-af44-4c30-8277-728540f2ccb9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:21.446963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 66/135] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:23:21 2022] PUT /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/users/41d518da297c4aae97a3c4c58f295974/roles/af99020fdd8b4a4e93e3b913d49e9cf8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:21.447908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805767dd-7a8f-4ab2-bfa5-7eb9f535a8be None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:21.471825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 70/136] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:21.476649 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cab5ff-af44-4c30-8277-728540f2ccb9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:21.554101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:21.645223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805767dd-7a8f-4ab2-bfa5-7eb9f535a8be None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:21.718643 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3fe8a-ed61-4726-9223-296d79d7eb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:21.720034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3fe8a-ed61-4726-9223-296d79d7eb65 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.720324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3fe8a-ed61-4726-9223-296d79d7eb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.720603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3fe8a-ed61-4726-9223-296d79d7eb65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.721924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3fe8a-ed61-4726-9223-296d79d7eb65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:21.723524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3fe8a-ed61-4726-9223-296d79d7eb65 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:21.730502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 67/137] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:21.736947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3fe8a-ed61-4726-9223-296d79d7eb65 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:21.758130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cab5ff-af44-4c30-8277-728540f2ccb9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:21.776380 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:21.834386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddbbea-271b-44ba-929d-8e1c3511d67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:21.835781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddbbea-271b-44ba-929d-8e1c3511d67a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.836278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddbbea-271b-44ba-929d-8e1c3511d67a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.836787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ddbbea-271b-44ba-929d-8e1c3511d67a None admin] PATH_INFO: `/v3/users/41d518da297c4aae97a3c4c58f295974` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.839624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddbbea-271b-44ba-929d-8e1c3511d67a None admin] RBAC: Authorizing `identity:get_user(user_id=41d518da297c4aae97a3c4c58f295974)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:21.841764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ddbbea-271b-44ba-929d-8e1c3511d67a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:21.848390 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 71/138] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:21 2022] GET /identity/v3/users/41d518da297c4aae97a3c4c58f295974 => generated 275 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:21.861755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddbbea-271b-44ba-929d-8e1c3511d67a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:21.905897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3fe8a-ed61-4726-9223-296d79d7eb65 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:21.926055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:21.943958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee24c7-67ab-43e5-8886-5a0fab4e6ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:21.944648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee24c7-67ab-43e5-8886-5a0fab4e6ba7 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:21.944941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee24c7-67ab-43e5-8886-5a0fab4e6ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:21.945222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee24c7-67ab-43e5-8886-5a0fab4e6ba7 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:21.945976 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee24c7-67ab-43e5-8886-5a0fab4e6ba7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:21.947538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee24c7-67ab-43e5-8886-5a0fab4e6ba7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:22.032989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ddbbea-271b-44ba-929d-8e1c3511d67a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:22.057791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 68/139] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:23:21 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:22.093188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a5070b-523c-433a-8ed5-efbc610b5073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:22.094675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5070b-523c-433a-8ed5-efbc610b5073 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:22.094982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5070b-523c-433a-8ed5-efbc610b5073 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:22.095266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a5070b-523c-433a-8ed5-efbc610b5073 None admin] PATH_INFO: `/v3/projects/8201df35ff52430a8d1a36841fa74018` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:22.096499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5070b-523c-433a-8ed5-efbc610b5073 None admin] RBAC: Authorizing `identity:get_project(project_id=8201df35ff52430a8d1a36841fa74018)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:22.098003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a5070b-523c-433a-8ed5-efbc610b5073 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:22.099729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 72/140] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:21 2022] GET /identity/v3/projects/8201df35ff52430a8d1a36841fa74018 => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:22.105917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee24c7-67ab-43e5-8886-5a0fab4e6ba7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:22.297712 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee24c7-67ab-43e5-8886-5a0fab4e6ba7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:22.333532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1f2baa-48ea-4d82-8cbb-dc695ff5b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:22.334464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f2baa-48ea-4d82-8cbb-dc695ff5b347 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:22.334753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f2baa-48ea-4d82-8cbb-dc695ff5b347 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:22.335043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1f2baa-48ea-4d82-8cbb-dc695ff5b347 None admin] PATH_INFO: `/v3/projects/8201df35ff52430a8d1a36841fa74018/users/41d518da297c4aae97a3c4c58f295974/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:22.337025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f2baa-48ea-4d82-8cbb-dc695ff5b347 None admin] RBAC: Authorizing `identity:create_grant(project_id=8201df35ff52430a8d1a36841fa74018, user_id=41d518da297c4aae97a3c4c58f295974, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:22.338514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1f2baa-48ea-4d82-8cbb-dc695ff5b347 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:22.417614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 69/141] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:23:22 2022] PUT /identity/v3/projects/8201df35ff52430a8d1a36841fa74018/users/41d518da297c4aae97a3c4c58f295974/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:22.923334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ba5d-79f8-4c2d-be8c-cd9ef8cccd92 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:22.923832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ba5d-79f8-4c2d-be8c-cd9ef8cccd92 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:22.923903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868ba5d-79f8-4c2d-be8c-cd9ef8cccd92 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:22.925282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 73/142] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:22.931445 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f66ed6-bacd-4228-99ad-71a718e52942 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:22.932302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f66ed6-bacd-4228-99ad-71a718e52942 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:22.932784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f66ed6-bacd-4228-99ad-71a718e52942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:22.954339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-61f66ed6-bacd-4228-99ad-71a718e52942 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:22.956062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-61f66ed6-bacd-4228-99ad-71a718e52942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:22.989025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:23.055626 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 70/143] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:23.096089 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ba5d-79f8-4c2d-be8c-cd9ef8cccd92 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:23.152578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:23.226764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868ba5d-79f8-4c2d-be8c-cd9ef8cccd92 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:23.246414 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62330d-ee42-4cd7-9612-761042dbd795 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:23.247287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62330d-ee42-4cd7-9612-761042dbd795 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:23.247769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62330d-ee42-4cd7-9612-761042dbd795 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:23.249393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 71/144] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:23.254888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3725c8c-d1b5-4055-b0dd-e72a5b50e8f2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:23.255475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3725c8c-d1b5-4055-b0dd-e72a5b50e8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:23.256111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3725c8c-d1b5-4055-b0dd-e72a5b50e8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:23.280696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637d809-7389-49f0-acf2-1ad77c039a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:23.285358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637d809-7389-49f0-acf2-1ad77c039a6b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:23.285358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637d809-7389-49f0-acf2-1ad77c039a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:23.285358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637d809-7389-49f0-acf2-1ad77c039a6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:23.288145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a3725c8c-d1b5-4055-b0dd-e72a5b50e8f2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:23.289635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a3725c8c-d1b5-4055-b0dd-e72a5b50e8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:23.306971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637d809-7389-49f0-acf2-1ad77c039a6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f637d809-7389-49f0-acf2-1ad77c039a6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:23.314868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:23.315720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:23.316479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 74/145] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:23.325219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637d809-7389-49f0-acf2-1ad77c039a6b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:23.402287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 72/146] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:23.415407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3887791-c9f2-4494-a7d7-a0d74292f9e2 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:23.416027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3887791-c9f2-4494-a7d7-a0d74292f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:23.416514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3887791-c9f2-4494-a7d7-a0d74292f9e2 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:23.418111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 73/147] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:23.424475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26423a40-8934-4190-97de-00c976b74ecd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:23.424772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26423a40-8934-4190-97de-00c976b74ecd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:23.425072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26423a40-8934-4190-97de-00c976b74ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:23.444247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-26423a40-8934-4190-97de-00c976b74ecd None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:23.445558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-26423a40-8934-4190-97de-00c976b74ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:23.538662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:23.543078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637d809-7389-49f0-acf2-1ad77c039a6b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:23.568233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 74/148] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:23.569102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26423a40-8934-4190-97de-00c976b74ecd None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:23.606040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:23.610151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f50f5f-e6ae-4a92-b53e-27c67e644d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:23.610842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f50f5f-e6ae-4a92-b53e-27c67e644d1e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:23.611128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f50f5f-e6ae-4a92-b53e-27c67e644d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:23.611407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f50f5f-e6ae-4a92-b53e-27c67e644d1e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:23.612174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f50f5f-e6ae-4a92-b53e-27c67e644d1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:23.612484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f50f5f-e6ae-4a92-b53e-27c67e644d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:23.614939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f50f5f-e6ae-4a92-b53e-27c67e644d1e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:23.631774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 75/149] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:23.632641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f50f5f-e6ae-4a92-b53e-27c67e644d1e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:23.750632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26423a40-8934-4190-97de-00c976b74ecd None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:23.797473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f50f5f-e6ae-4a92-b53e-27c67e644d1e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:23.808985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faeb8b-b46d-475d-b1d9-c24a0cb29e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:23.810133 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faeb8b-b46d-475d-b1d9-c24a0cb29e11 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:23.810645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faeb8b-b46d-475d-b1d9-c24a0cb29e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:23.811066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faeb8b-b46d-475d-b1d9-c24a0cb29e11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:23.837347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dc1fb-88f6-4e66-afc3-7efe8e0151e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:23.838518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faeb8b-b46d-475d-b1d9-c24a0cb29e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:23.838636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dc1fb-88f6-4e66-afc3-7efe8e0151e2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:23.838999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dc1fb-88f6-4e66-afc3-7efe8e0151e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:23.839407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239dc1fb-88f6-4e66-afc3-7efe8e0151e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-05faeb8b-b46d-475d-b1d9-c24a0cb29e11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:23.847859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:23.849019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:23.854039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:23.854601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239dc1fb-88f6-4e66-afc3-7efe8e0151e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:23.856240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 75/150] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:23.859438 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faeb8b-b46d-475d-b1d9-c24a0cb29e11 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-239dc1fb-88f6-4e66-afc3-7efe8e0151e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:23.866601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:23.867446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:23.868803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 76/151] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:23:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:23.870532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dc1fb-88f6-4e66-afc3-7efe8e0151e2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:23.917144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:24.024636 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:24.051856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faeb8b-b46d-475d-b1d9-c24a0cb29e11 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:24.061420 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239dc1fb-88f6-4e66-afc3-7efe8e0151e2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:24.087245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84de5b9-6bf2-4308-831c-e419d99b4625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:24.088210 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84de5b9-6bf2-4308-831c-e419d99b4625 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:24.088851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84de5b9-6bf2-4308-831c-e419d99b4625 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:24.089330 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84de5b9-6bf2-4308-831c-e419d99b4625 None admin] PATH_INFO: `/v3/users/edef234764cd4cee94a25f79c1acebb0` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:24.091189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84de5b9-6bf2-4308-831c-e419d99b4625 None admin] RBAC: Authorizing `identity:get_user(user_id=edef234764cd4cee94a25f79c1acebb0)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:24.092759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84de5b9-6bf2-4308-831c-e419d99b4625 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:24.094864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 76/152] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:23 2022] GET /identity/v3/users/edef234764cd4cee94a25f79c1acebb0 => generated 289 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:24.095727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84de5b9-6bf2-4308-831c-e419d99b4625 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:24.147658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed623cb-0227-4362-a1fb-3d00aa2e8d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:24.152482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed623cb-0227-4362-a1fb-3d00aa2e8d4a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:24.152778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed623cb-0227-4362-a1fb-3d00aa2e8d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:24.153064 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed623cb-0227-4362-a1fb-3d00aa2e8d4a None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:24.153862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed623cb-0227-4362-a1fb-3d00aa2e8d4a None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:24.154181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed623cb-0227-4362-a1fb-3d00aa2e8d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:24.155632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed623cb-0227-4362-a1fb-3d00aa2e8d4a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:24.177010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 77/153] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:24.177898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed623cb-0227-4362-a1fb-3d00aa2e8d4a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:24.280660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84de5b9-6bf2-4308-831c-e419d99b4625 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:24.350333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:24.370388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa22b1e-cc1f-4f8c-a33a-923f16a5f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:24.371078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa22b1e-cc1f-4f8c-a33a-923f16a5f645 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:24.371363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa22b1e-cc1f-4f8c-a33a-923f16a5f645 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:24.371902 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa22b1e-cc1f-4f8c-a33a-923f16a5f645 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:24.372072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed623cb-0227-4362-a1fb-3d00aa2e8d4a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:24.372662 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa22b1e-cc1f-4f8c-a33a-923f16a5f645 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:24.372967 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa22b1e-cc1f-4f8c-a33a-923f16a5f645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:24.376486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa22b1e-cc1f-4f8c-a33a-923f16a5f645 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:24.395860 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 77/154] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:24.396718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa22b1e-cc1f-4f8c-a33a-923f16a5f645 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:24.420067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:24.433408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840f7cb-0ce3-474b-a1a2-b5c78b5beccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:24.434506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f7cb-0ce3-474b-a1a2-b5c78b5beccd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:24.434800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f7cb-0ce3-474b-a1a2-b5c78b5beccd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:24.435082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840f7cb-0ce3-474b-a1a2-b5c78b5beccd None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:24.438562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840f7cb-0ce3-474b-a1a2-b5c78b5beccd None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:24.438562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840f7cb-0ce3-474b-a1a2-b5c78b5beccd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:24.441032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 78/155] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:24 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:24.446647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840f7cb-0ce3-474b-a1a2-b5c78b5beccd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:24.618442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa22b1e-cc1f-4f8c-a33a-923f16a5f645 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:24.670299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a46a-bb04-44cc-b082-e9db9b3474b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:24.671426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a46a-bb04-44cc-b082-e9db9b3474b8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:24.671878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a46a-bb04-44cc-b082-e9db9b3474b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:24.672807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840f7cb-0ce3-474b-a1a2-b5c78b5beccd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:24.672950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0a46a-bb04-44cc-b082-e9db9b3474b8 None admin] PATH_INFO: `/v3/users/41d518da297c4aae97a3c4c58f295974` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:24.674103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0a46a-bb04-44cc-b082-e9db9b3474b8 None admin] RBAC: Authorizing `identity:get_user(user_id=41d518da297c4aae97a3c4c58f295974)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:24.675649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0a46a-bb04-44cc-b082-e9db9b3474b8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:24.677365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 78/156] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:24 2022] GET /identity/v3/users/41d518da297c4aae97a3c4c58f295974 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:24.682668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a46a-bb04-44cc-b082-e9db9b3474b8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:24.725829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc977485-e570-45a0-8d27-7f532e577555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:24.726868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc977485-e570-45a0-8d27-7f532e577555 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:24.727349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc977485-e570-45a0-8d27-7f532e577555 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:24.727761 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc977485-e570-45a0-8d27-7f532e577555 None admin] PATH_INFO: `/v3/users/46fa2a18bf5f49108e7df3a32506426e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:24.730343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc977485-e570-45a0-8d27-7f532e577555 None admin] RBAC: Authorizing `identity:get_user(user_id=46fa2a18bf5f49108e7df3a32506426e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:24.731913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc977485-e570-45a0-8d27-7f532e577555 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:24.735757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 79/157] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:24 2022] GET /identity/v3/users/46fa2a18bf5f49108e7df3a32506426e => generated 247 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:24.736678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc977485-e570-45a0-8d27-7f532e577555 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:24.770361 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:24.775963 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:24.791756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0a46a-bb04-44cc-b082-e9db9b3474b8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:24.827093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f6d4a-e2aa-4e30-9175-4edb7c0b6660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:24.828313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f6d4a-e2aa-4e30-9175-4edb7c0b6660 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:24.828802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f6d4a-e2aa-4e30-9175-4edb7c0b6660 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:24.829254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f6d4a-e2aa-4e30-9175-4edb7c0b6660 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/users/edef234764cd4cee94a25f79c1acebb0/roles/35bddef47fa34f62be6f49ddad1b12aa` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:24.831453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f6d4a-e2aa-4e30-9175-4edb7c0b6660 None admin] RBAC: Authorizing `identity:create_grant(project_id=058eb95aa34c4eed9a28c8cee87c0c14, user_id=edef234764cd4cee94a25f79c1acebb0, role_id=35bddef47fa34f62be6f49ddad1b12aa)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:24.833098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f6d4a-e2aa-4e30-9175-4edb7c0b6660 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:24.921591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc977485-e570-45a0-8d27-7f532e577555 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:24.935854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 79/158] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:23:24 2022] PUT /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/users/edef234764cd4cee94a25f79c1acebb0/roles/35bddef47fa34f62be6f49ddad1b12aa => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:24.936999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f6d4a-e2aa-4e30-9175-4edb7c0b6660 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:24.992321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802679e-9245-4996-996c-c050d1ed0539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:24.994126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802679e-9245-4996-996c-c050d1ed0539 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:24.995328 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802679e-9245-4996-996c-c050d1ed0539 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:24.995813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802679e-9245-4996-996c-c050d1ed0539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.157532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f6d4a-e2aa-4e30-9175-4edb7c0b6660 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:25.158644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802679e-9245-4996-996c-c050d1ed0539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:25.160240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802679e-9245-4996-996c-c050d1ed0539 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:25.215642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742499d-4e31-4ac1-b53d-c758bbd0cd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:25.216239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742499d-4e31-4ac1-b53d-c758bbd0cd57 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.216529 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742499d-4e31-4ac1-b53d-c758bbd0cd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.216809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1742499d-4e31-4ac1-b53d-c758bbd0cd57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.221458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:25.225489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:25.315313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742499d-4e31-4ac1-b53d-c758bbd0cd57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:25.317087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1742499d-4e31-4ac1-b53d-c758bbd0cd57 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:25.434804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 80/159] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:25.442736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742499d-4e31-4ac1-b53d-c758bbd0cd57 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:25.446358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 80/160] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:25.462412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802679e-9245-4996-996c-c050d1ed0539 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:25.494161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:25.554879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1742499d-4e31-4ac1-b53d-c758bbd0cd57 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:25.600207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7504-47a4-4a34-8240-be3b18b722bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:25.601317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7504-47a4-4a34-8240-be3b18b722bf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.601809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7504-47a4-4a34-8240-be3b18b722bf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.602222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de7504-47a4-4a34-8240-be3b18b722bf None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.603544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7504-47a4-4a34-8240-be3b18b722bf None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:25.605145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de7504-47a4-4a34-8240-be3b18b722bf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:25.607326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 81/161] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:25 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:25.613105 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7504-47a4-4a34-8240-be3b18b722bf None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:25.662847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802679e-9245-4996-996c-c050d1ed0539 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:25.697790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:25.726561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4ae7b-80c9-45b2-870e-f7bde2841e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:25.727675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ae7b-80c9-45b2-870e-f7bde2841e4d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.728115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ae7b-80c9-45b2-870e-f7bde2841e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.728578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4ae7b-80c9-45b2-870e-f7bde2841e4d None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.729959 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4ae7b-80c9-45b2-870e-f7bde2841e4d None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:25.731577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4ae7b-80c9-45b2-870e-f7bde2841e4d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:25.737774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 81/162] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:25 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:25.747474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd4a62-35e3-44bb-bd56-e30616402dce None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.747966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd4a62-35e3-44bb-bd56-e30616402dce None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.748398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd4a62-35e3-44bb-bd56-e30616402dce None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.749923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 82/163] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:25.750974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd4a62-35e3-44bb-bd56-e30616402dce None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:25.766911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de7504-47a4-4a34-8240-be3b18b722bf None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:25.773697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:25.835462 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52f65a-08f9-48df-8c6f-b00f08bf733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:25.837042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f65a-08f9-48df-8c6f-b00f08bf733f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.837488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f65a-08f9-48df-8c6f-b00f08bf733f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.837939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52f65a-08f9-48df-8c6f-b00f08bf733f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.838955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52f65a-08f9-48df-8c6f-b00f08bf733f None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14, user.id=46fa2a18bf5f49108e7df3a32506426e) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:25.839423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52f65a-08f9-48df-8c6f-b00f08bf733f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:25.841035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52f65a-08f9-48df-8c6f-b00f08bf733f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:25.855788 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 82/164] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:25 2022] GET /identity/v3/role_assignments?user.id=46fa2a18bf5f49108e7df3a32506426e&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:25.857548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628321d-497a-4cb0-9e0e-dada820b0cd1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:25.858161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628321d-497a-4cb0-9e0e-dada820b0cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:25.858592 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628321d-497a-4cb0-9e0e-dada820b0cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:25.891617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7628321d-497a-4cb0-9e0e-dada820b0cd1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:25.893197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7628321d-497a-4cb0-9e0e-dada820b0cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:25.955740 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd4a62-35e3-44bb-bd56-e30616402dce None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.003174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6900d89-b731-4376-afbd-a59c48798583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.004062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6900d89-b731-4376-afbd-a59c48798583 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.004490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6900d89-b731-4376-afbd-a59c48798583 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.004909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6900d89-b731-4376-afbd-a59c48798583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.005911 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6900d89-b731-4376-afbd-a59c48798583 None admin] RBAC: Adding query filter params (role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14, user.id=41d518da297c4aae97a3c4c58f295974) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:26.006388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6900d89-b731-4376-afbd-a59c48798583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:26.007982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6900d89-b731-4376-afbd-a59c48798583 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:26.014755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 83/165] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:25 2022] GET /identity/v3/role_assignments?user.id=41d518da297c4aae97a3c4c58f295974&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:26.043080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 83/166] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:26.095322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6900d89-b731-4376-afbd-a59c48798583 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:26.174955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:26.231734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6900d89-b731-4376-afbd-a59c48798583 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.270061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fca35-b9b1-4f03-89e2-ac27a31d1565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.270815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fca35-b9b1-4f03-89e2-ac27a31d1565 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.271099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fca35-b9b1-4f03-89e2-ac27a31d1565 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.271373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fca35-b9b1-4f03-89e2-ac27a31d1565 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.284108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fca35-b9b1-4f03-89e2-ac27a31d1565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-467fca35-b9b1-4f03-89e2-ac27a31d1565 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:26.292524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:26.293560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:26.294800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 84/167] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:26.300294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628321d-497a-4cb0-9e0e-dada820b0cd1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:26.430551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:26.435270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628321d-497a-4cb0-9e0e-dada820b0cd1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.522800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee3349-2450-4451-b4c7-e2d67db62d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.523416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3349-2450-4451-b4c7-e2d67db62d85 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.523702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3349-2450-4451-b4c7-e2d67db62d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.523979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee3349-2450-4451-b4c7-e2d67db62d85 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.524753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee3349-2450-4451-b4c7-e2d67db62d85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:26.525062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee3349-2450-4451-b4c7-e2d67db62d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:26.526545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee3349-2450-4451-b4c7-e2d67db62d85 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:26.541723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 84/168] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:26.547904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fca35-b9b1-4f03-89e2-ac27a31d1565 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:26.677111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fca35-b9b1-4f03-89e2-ac27a31d1565 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.714132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:26.739936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc012935-f5fc-4a90-b5df-0a760176fcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.741220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012935-f5fc-4a90-b5df-0a760176fcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.741719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012935-f5fc-4a90-b5df-0a760176fcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.742220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc012935-f5fc-4a90-b5df-0a760176fcc5 None admin] PATH_INFO: `/v3/users/41d518da297c4aae97a3c4c58f295974` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.744564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc012935-f5fc-4a90-b5df-0a760176fcc5 None admin] RBAC: Authorizing `identity:get_user(user_id=41d518da297c4aae97a3c4c58f295974)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:26.746254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc012935-f5fc-4a90-b5df-0a760176fcc5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:26.748464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 85/169] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:26 2022] GET /identity/v3/users/41d518da297c4aae97a3c4c58f295974 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:26.754050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee3349-2450-4451-b4c7-e2d67db62d85 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:26.876609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee3349-2450-4451-b4c7-e2d67db62d85 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:26.911417 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce2967-dd07-49f4-9f58-29ea39fb91b4 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.912028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce2967-dd07-49f4-9f58-29ea39fb91b4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.912505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce2967-dd07-49f4-9f58-29ea39fb91b4 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.914182 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 86/170] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:26.916892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8844ba-8e38-435d-a35b-f1eb3cc41780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:26.917574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8844ba-8e38-435d-a35b-f1eb3cc41780 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.917871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8844ba-8e38-435d-a35b-f1eb3cc41780 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.918156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8844ba-8e38-435d-a35b-f1eb3cc41780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.920514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b8edb-a008-4544-9914-a7a88f839338 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:26.921138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b8edb-a008-4544-9914-a7a88f839338 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:26.921620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8b8edb-a008-4544-9914-a7a88f839338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:26.950302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:26.954595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1e8b8edb-a008-4544-9914-a7a88f839338 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:26.956174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1e8b8edb-a008-4544-9914-a7a88f839338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:27.020651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8844ba-8e38-435d-a35b-f1eb3cc41780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:27.023013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8844ba-8e38-435d-a35b-f1eb3cc41780 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:27.085111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 87/171] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:27.089703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf183f6c-a0c9-4944-98eb-8c8123f646a6 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.089703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf183f6c-a0c9-4944-98eb-8c8123f646a6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.089703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf183f6c-a0c9-4944-98eb-8c8123f646a6 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.089703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 88/172] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:27.121639 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849d1c8-79fe-45bf-8e9b-85263442c362 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.121999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849d1c8-79fe-45bf-8e9b-85263442c362 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.122250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849d1c8-79fe-45bf-8e9b-85263442c362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.157959 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d849d1c8-79fe-45bf-8e9b-85263442c362 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:27.159075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d849d1c8-79fe-45bf-8e9b-85263442c362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:27.224033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 85/173] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:27.224972 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8844ba-8e38-435d-a35b-f1eb3cc41780 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.286686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 89/174] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:27.288996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849d1c8-79fe-45bf-8e9b-85263442c362 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.334385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:27.366052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:27.395547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8844ba-8e38-435d-a35b-f1eb3cc41780 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:27.435020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f75cd6-6883-4b3d-9352-1fff4491495a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:27.435726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f75cd6-6883-4b3d-9352-1fff4491495a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.436008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f75cd6-6883-4b3d-9352-1fff4491495a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.436280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f75cd6-6883-4b3d-9352-1fff4491495a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.446842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f75cd6-6883-4b3d-9352-1fff4491495a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:27.447339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849d1c8-79fe-45bf-8e9b-85263442c362 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-91f75cd6-6883-4b3d-9352-1fff4491495a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:27.455204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:27.456063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:27.456824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 86/175] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:27.457521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f75cd6-6883-4b3d-9352-1fff4491495a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.487643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76fc90-9652-4e9d-b960-8249d8250add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:27.488534 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76fc90-9652-4e9d-b960-8249d8250add None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.488859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76fc90-9652-4e9d-b960-8249d8250add None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.489138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76fc90-9652-4e9d-b960-8249d8250add None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.490559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76fc90-9652-4e9d-b960-8249d8250add None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:27.492035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76fc90-9652-4e9d-b960-8249d8250add None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:27.494049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 90/176] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:27 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:27.495226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d3a99-ae4a-4b57-8ea1-97b2d6c7f9e7 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.495512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d3a99-ae4a-4b57-8ea1-97b2d6c7f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.495782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d3a99-ae4a-4b57-8ea1-97b2d6c7f9e7 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.497400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 91/177] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:27.502384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d3a99-ae4a-4b57-8ea1-97b2d6c7f9e7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.581807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f75cd6-6883-4b3d-9352-1fff4491495a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:27.603400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:27.612169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d3a99-ae4a-4b57-8ea1-97b2d6c7f9e7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:27.618578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058a690-3155-4748-a0d6-b767d2148ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:27.619447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058a690-3155-4748-a0d6-b767d2148ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.619798 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058a690-3155-4748-a0d6-b767d2148ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.620087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4058a690-3155-4748-a0d6-b767d2148ea3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.622891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:27.632884 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4058a690-3155-4748-a0d6-b767d2148ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-4058a690-3155-4748-a0d6-b767d2148ea3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:27.641916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:27.642992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:27.644020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:27.646157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 87/178] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:23:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:27.648030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058a690-3155-4748-a0d6-b767d2148ea3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.650909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329cea42-b77f-41d2-9ab2-e4232f5a3596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:27.651504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cea42-b77f-41d2-9ab2-e4232f5a3596 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.652566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cea42-b77f-41d2-9ab2-e4232f5a3596 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.652566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329cea42-b77f-41d2-9ab2-e4232f5a3596 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.653039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cea42-b77f-41d2-9ab2-e4232f5a3596 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:27.653405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cea42-b77f-41d2-9ab2-e4232f5a3596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:27.654889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329cea42-b77f-41d2-9ab2-e4232f5a3596 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:27.663982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 92/179] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:27.665767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116ce3-2a02-4955-9617-259f97183f05 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.665899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116ce3-2a02-4955-9617-259f97183f05 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.666256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3116ce3-2a02-4955-9617-259f97183f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.685144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a3116ce3-2a02-4955-9617-259f97183f05 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:27.686517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a3116ce3-2a02-4955-9617-259f97183f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:27.756382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4058a690-3155-4748-a0d6-b767d2148ea3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:27.769687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 93/180] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:27.769687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3116ce3-2a02-4955-9617-259f97183f05 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.794870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328516ca-c50e-4a3a-b9b2-1eb2dfd60862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:27.795316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328516ca-c50e-4a3a-b9b2-1eb2dfd60862 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.795605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328516ca-c50e-4a3a-b9b2-1eb2dfd60862 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.795885 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328516ca-c50e-4a3a-b9b2-1eb2dfd60862 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.796723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328516ca-c50e-4a3a-b9b2-1eb2dfd60862 None admin] RBAC: Adding query filter params (role.id=af99020fdd8b4a4e93e3b913d49e9cf8, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14, user.id=41d518da297c4aae97a3c4c58f295974) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:27.797099 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328516ca-c50e-4a3a-b9b2-1eb2dfd60862 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:27.798731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328516ca-c50e-4a3a-b9b2-1eb2dfd60862 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:27.804985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 88/181] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:27 2022] GET /identity/v3/role_assignments?user.id=41d518da297c4aae97a3c4c58f295974&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=af99020fdd8b4a4e93e3b913d49e9cf8 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:27.805706 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328516ca-c50e-4a3a-b9b2-1eb2dfd60862 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.860286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:27.917148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:27.922283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3116ce3-2a02-4955-9617-259f97183f05 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:27.929077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328516ca-c50e-4a3a-b9b2-1eb2dfd60862 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:27.967182 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2338f3-798e-40d5-9a37-5c82502a6472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:27.967953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2338f3-798e-40d5-9a37-5c82502a6472 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.968372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2338f3-798e-40d5-9a37-5c82502a6472 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.968769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2338f3-798e-40d5-9a37-5c82502a6472 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.969701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2338f3-798e-40d5-9a37-5c82502a6472 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:27.970194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2338f3-798e-40d5-9a37-5c82502a6472 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:27.971669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2338f3-798e-40d5-9a37-5c82502a6472 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:27.978802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1fd31-4f95-4809-928e-2614eda96d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:27.979707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1fd31-4f95-4809-928e-2614eda96d42 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.979994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1fd31-4f95-4809-928e-2614eda96d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.980275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1fd31-4f95-4809-928e-2614eda96d42 None admin] PATH_INFO: `/v3/users/41d518da297c4aae97a3c4c58f295974` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.981560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1fd31-4f95-4809-928e-2614eda96d42 None admin] RBAC: Authorizing `identity:get_user(user_id=41d518da297c4aae97a3c4c58f295974)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:27.983088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1fd31-4f95-4809-928e-2614eda96d42 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:27.983726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 94/182] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:27.985412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a4861-6fdf-4dfc-b77d-0683a4d0cce7 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:27.985931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a4861-6fdf-4dfc-b77d-0683a4d0cce7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:27.986401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a4861-6fdf-4dfc-b77d-0683a4d0cce7 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:27.987874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 95/183] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:27.988759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a4861-6fdf-4dfc-b77d-0683a4d0cce7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:27.989695 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 89/184] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:27 2022] GET /identity/v3/users/41d518da297c4aae97a3c4c58f295974 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:27.991178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1fd31-4f95-4809-928e-2614eda96d42 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:28.116199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1fd31-4f95-4809-928e-2614eda96d42 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:28.125847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a4861-6fdf-4dfc-b77d-0683a4d0cce7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:28.131573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:28.153411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd78fd-68f3-4291-9b37-40170f0d7eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:28.154378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd78fd-68f3-4291-9b37-40170f0d7eee None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:28.154661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd78fd-68f3-4291-9b37-40170f0d7eee None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:28.154939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd78fd-68f3-4291-9b37-40170f0d7eee None admin] PATH_INFO: `/v3/users/c497a16afc3a433088dca5c4ab1dd700` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:28.163868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272403-c816-4f89-94ed-363f28ae50c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:28.164670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272403-c816-4f89-94ed-363f28ae50c1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:28.164941 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272403-c816-4f89-94ed-363f28ae50c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:28.165224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0272403-c816-4f89-94ed-363f28ae50c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:28.166404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0272403-c816-4f89-94ed-363f28ae50c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:28.167858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0272403-c816-4f89-94ed-363f28ae50c1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:28.169478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 96/185] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:28.169478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272403-c816-4f89-94ed-363f28ae50c1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:28.175005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd78fd-68f3-4291-9b37-40170f0d7eee None admin] RBAC: Authorizing `identity:get_user(user_id=c497a16afc3a433088dca5c4ab1dd700)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:28.176492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd78fd-68f3-4291-9b37-40170f0d7eee None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:28.178422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 90/186] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:27 2022] GET /identity/v3/users/c497a16afc3a433088dca5c4ab1dd700 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:28.179930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75276-3dab-45c5-b830-e3df17012d82 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:28.180227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75276-3dab-45c5-b830-e3df17012d82 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:28.180509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee75276-3dab-45c5-b830-e3df17012d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:28.197553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fee75276-3dab-45c5-b830-e3df17012d82 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:28.198762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fee75276-3dab-45c5-b830-e3df17012d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:28.202169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:28.276663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 91/187] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:28.277258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee75276-3dab-45c5-b830-e3df17012d82 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:28.294240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0272403-c816-4f89-94ed-363f28ae50c1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:28.339440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01980a-9919-4c56-82ad-70cc83b1df41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:28.340360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01980a-9919-4c56-82ad-70cc83b1df41 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:28.340786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01980a-9919-4c56-82ad-70cc83b1df41 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:28.341738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01980a-9919-4c56-82ad-70cc83b1df41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:28.390511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:28.393561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee75276-3dab-45c5-b830-e3df17012d82 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:28.416963 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01980a-9919-4c56-82ad-70cc83b1df41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:28.418471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01980a-9919-4c56-82ad-70cc83b1df41 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:28.431166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282ca84-a302-4420-a55e-19f5907065e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:28.431843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282ca84-a302-4420-a55e-19f5907065e3 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:28.432125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282ca84-a302-4420-a55e-19f5907065e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:28.432402 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282ca84-a302-4420-a55e-19f5907065e3 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:28.433203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282ca84-a302-4420-a55e-19f5907065e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:28.434804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3282ca84-a302-4420-a55e-19f5907065e3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:28.448368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:28.508183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 92/188] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:23:28 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:28.509300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282ca84-a302-4420-a55e-19f5907065e3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:28.526783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 97/189] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:28.528132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01980a-9919-4c56-82ad-70cc83b1df41 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:28.629601 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282ca84-a302-4420-a55e-19f5907065e3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:28.643034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01980a-9919-4c56-82ad-70cc83b1df41 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:28.669342 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bc1b8-95f0-4522-a97d-d5e71bfcbbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:28.670406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bc1b8-95f0-4522-a97d-d5e71bfcbbc2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:28.670699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bc1b8-95f0-4522-a97d-d5e71bfcbbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:28.671163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bc1b8-95f0-4522-a97d-d5e71bfcbbc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:28.676778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:28.681499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c7382-fa8c-4263-946d-ebf4b6b80885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:28.682362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c7382-fa8c-4263-946d-ebf4b6b80885 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:28.682653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c7382-fa8c-4263-946d-ebf4b6b80885 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:28.682934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c7382-fa8c-4263-946d-ebf4b6b80885 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:28.696173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c7382-fa8c-4263-946d-ebf4b6b80885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:28.702616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-262c7382-fa8c-4263-946d-ebf4b6b80885 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:28.704476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:28.705543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:28.706623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 98/190] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:28.707736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075f7fb-431c-424e-8501-4406c6430d93 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:28.708025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075f7fb-431c-424e-8501-4406c6430d93 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:28.708302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075f7fb-431c-424e-8501-4406c6430d93 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:28.709549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 99/191] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:28.710294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075f7fb-431c-424e-8501-4406c6430d93 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:28.761902 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bc1b8-95f0-4522-a97d-d5e71bfcbbc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:28.763391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bc1b8-95f0-4522-a97d-d5e71bfcbbc2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:28.850495 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075f7fb-431c-424e-8501-4406c6430d93 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:28.880705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 93/192] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:28.881588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bc1b8-95f0-4522-a97d-d5e71bfcbbc2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:28.896596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29d30c-d73f-4124-a117-a6564c7e8258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:28.897701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29d30c-d73f-4124-a117-a6564c7e8258 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:28.898247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29d30c-d73f-4124-a117-a6564c7e8258 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:28.898642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29d30c-d73f-4124-a117-a6564c7e8258 None admin] PATH_INFO: `/v3/projects/8201df35ff52430a8d1a36841fa74018` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:28.900055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29d30c-d73f-4124-a117-a6564c7e8258 None admin] RBAC: Authorizing `identity:get_project(project_id=8201df35ff52430a8d1a36841fa74018)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:28.901655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b29d30c-d73f-4124-a117-a6564c7e8258 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:28.903790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 100/193] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:28 2022] GET /identity/v3/projects/8201df35ff52430a8d1a36841fa74018 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:28.909074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575095-d4f7-42c6-af3d-c54b484a1910 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:28.909507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575095-d4f7-42c6-af3d-c54b484a1910 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:28.910050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20575095-d4f7-42c6-af3d-c54b484a1910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:28.930751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-20575095-d4f7-42c6-af3d-c54b484a1910 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:28.932067 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-20575095-d4f7-42c6-af3d-c54b484a1910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:28.943395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:28.988050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bc1b8-95f0-4522-a97d-d5e71bfcbbc2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:28.991128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.006750 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 101/194] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:29.014705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20575095-d4f7-42c6-af3d-c54b484a1910 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.025857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcba1e7-2d94-4c50-8ab1-0203fe1711e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.026839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba1e7-2d94-4c50-8ab1-0203fe1711e4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.027348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba1e7-2d94-4c50-8ab1-0203fe1711e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.027819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba1e7-2d94-4c50-8ab1-0203fe1711e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.028761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcba1e7-2d94-4c50-8ab1-0203fe1711e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:29.029262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcba1e7-2d94-4c50-8ab1-0203fe1711e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.030871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcba1e7-2d94-4c50-8ab1-0203fe1711e4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.040242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 94/195] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:29.041389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcba1e7-2d94-4c50-8ab1-0203fe1711e4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.132505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20575095-d4f7-42c6-af3d-c54b484a1910 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.145082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcba1e7-2d94-4c50-8ab1-0203fe1711e4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.168257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5c6fd-5d34-4e22-b12c-b16d7bffca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.169386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c6fd-5d34-4e22-b12c-b16d7bffca80 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.169841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c6fd-5d34-4e22-b12c-b16d7bffca80 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.170253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5c6fd-5d34-4e22-b12c-b16d7bffca80 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.171585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5c6fd-5d34-4e22-b12c-b16d7bffca80 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.172113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.173071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5c6fd-5d34-4e22-b12c-b16d7bffca80 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.174821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 102/196] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:29.175673 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5c6fd-5d34-4e22-b12c-b16d7bffca80 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.189704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f515e23-4275-4bad-85fd-b2fe178cbd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.190866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f515e23-4275-4bad-85fd-b2fe178cbd3e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.191718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f515e23-4275-4bad-85fd-b2fe178cbd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.192472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f515e23-4275-4bad-85fd-b2fe178cbd3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.193752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f515e23-4275-4bad-85fd-b2fe178cbd3e None admin] RBAC: Adding query filter params (role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, scope.project.id=8201df35ff52430a8d1a36841fa74018, user.id=41d518da297c4aae97a3c4c58f295974) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:29.194608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f515e23-4275-4bad-85fd-b2fe178cbd3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.196281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f515e23-4275-4bad-85fd-b2fe178cbd3e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.205626 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 95/197] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/role_assignments?user.id=41d518da297c4aae97a3c4c58f295974&scope.project.id=8201df35ff52430a8d1a36841fa74018&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:29.206751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f515e23-4275-4bad-85fd-b2fe178cbd3e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.282709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.353107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f515e23-4275-4bad-85fd-b2fe178cbd3e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.385723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5c6fd-5d34-4e22-b12c-b16d7bffca80 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.427123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77b81-2871-4bfc-9a62-82510c242114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.428041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77b81-2871-4bfc-9a62-82510c242114 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.428327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77b81-2871-4bfc-9a62-82510c242114 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.428609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d77b81-2871-4bfc-9a62-82510c242114 None admin] PATH_INFO: `/v3/users/c497a16afc3a433088dca5c4ab1dd700` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.429854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d77b81-2871-4bfc-9a62-82510c242114 None admin] RBAC: Authorizing `identity:get_user(user_id=c497a16afc3a433088dca5c4ab1dd700)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.431305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d77b81-2871-4bfc-9a62-82510c242114 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.433099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 103/198] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/users/c497a16afc3a433088dca5c4ab1dd700 => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:29.433702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77b81-2871-4bfc-9a62-82510c242114 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.436524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351c747-6a88-4852-9273-a0df2c43b11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.438447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351c747-6a88-4852-9273-a0df2c43b11b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.438937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351c747-6a88-4852-9273-a0df2c43b11b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.439411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351c747-6a88-4852-9273-a0df2c43b11b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.451856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351c747-6a88-4852-9273-a0df2c43b11b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c351c747-6a88-4852-9273-a0df2c43b11b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:29.460578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:29.461474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:29.462274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 96/199] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:29.462901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351c747-6a88-4852-9273-a0df2c43b11b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.550034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.560177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d77b81-2871-4bfc-9a62-82510c242114 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.587957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.600322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98aaf5-5f1c-4b97-9c5f-c2d9d149fb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.601289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98aaf5-5f1c-4b97-9c5f-c2d9d149fb30 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.601768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98aaf5-5f1c-4b97-9c5f-c2d9d149fb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.602197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98aaf5-5f1c-4b97-9c5f-c2d9d149fb30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.603036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98aaf5-5f1c-4b97-9c5f-c2d9d149fb30 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c, user.id=c497a16afc3a433088dca5c4ab1dd700) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:29.603344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98aaf5-5f1c-4b97-9c5f-c2d9d149fb30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.604788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98aaf5-5f1c-4b97-9c5f-c2d9d149fb30 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.606491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351c747-6a88-4852-9273-a0df2c43b11b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.612249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 104/200] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/role_assignments?user.id=c497a16afc3a433088dca5c4ab1dd700&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:29.612884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98aaf5-5f1c-4b97-9c5f-c2d9d149fb30 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.651122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0a3f-21e6-41c6-8c2b-106d1cf6e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.652106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0a3f-21e6-41c6-8c2b-106d1cf6e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.652610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0a3f-21e6-41c6-8c2b-106d1cf6e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.653082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c0a3f-21e6-41c6-8c2b-106d1cf6e9a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.740843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c0a3f-21e6-41c6-8c2b-106d1cf6e9a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.742821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c0a3f-21e6-41c6-8c2b-106d1cf6e9a8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.790545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:29.795679 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98aaf5-5f1c-4b97-9c5f-c2d9d149fb30 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:29.855103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 97/201] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:29.862169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0a3f-21e6-41c6-8c2b-106d1cf6e9a8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:29.880014 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee28390-7822-4579-85d3-a70f2ee2d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:29.881457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee28390-7822-4579-85d3-a70f2ee2d946 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:29.881973 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee28390-7822-4579-85d3-a70f2ee2d946 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:29.882623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee28390-7822-4579-85d3-a70f2ee2d946 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:29.888102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee28390-7822-4579-85d3-a70f2ee2d946 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:29.888102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee28390-7822-4579-85d3-a70f2ee2d946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:29.888102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee28390-7822-4579-85d3-a70f2ee2d946 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:29.903277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 105/202] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:29.911296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee28390-7822-4579-85d3-a70f2ee2d946 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:30.005658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:30.061306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c0a3f-21e6-41c6-8c2b-106d1cf6e9a8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:30.069855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee28390-7822-4579-85d3-a70f2ee2d946 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:30.111619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab58ad2-1122-4c94-9b4e-9bf09ed27cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:30.112506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab58ad2-1122-4c94-9b4e-9bf09ed27cfd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:30.112795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab58ad2-1122-4c94-9b4e-9bf09ed27cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:30.113075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab58ad2-1122-4c94-9b4e-9bf09ed27cfd None admin] PATH_INFO: `/v3/users/edef234764cd4cee94a25f79c1acebb0` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:30.114516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab58ad2-1122-4c94-9b4e-9bf09ed27cfd None admin] RBAC: Authorizing `identity:get_user(user_id=edef234764cd4cee94a25f79c1acebb0)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:30.116313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab58ad2-1122-4c94-9b4e-9bf09ed27cfd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:30.122051 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 106/203] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/users/edef234764cd4cee94a25f79c1acebb0 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:30.124117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab58ad2-1122-4c94-9b4e-9bf09ed27cfd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:30.199199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bdeb9-2a31-40d0-8bc2-16001fee3d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:30.200020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bdeb9-2a31-40d0-8bc2-16001fee3d3d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:30.200302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bdeb9-2a31-40d0-8bc2-16001fee3d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:30.200578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945bdeb9-2a31-40d0-8bc2-16001fee3d3d None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:30.202489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bdeb9-2a31-40d0-8bc2-16001fee3d3d None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:30.204007 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945bdeb9-2a31-40d0-8bc2-16001fee3d3d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:30.211169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 98/204] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:29 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:30.212000 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bdeb9-2a31-40d0-8bc2-16001fee3d3d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:30.229031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:30.265244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab58ad2-1122-4c94-9b4e-9bf09ed27cfd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:30.300717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:30.333905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945bdeb9-2a31-40d0-8bc2-16001fee3d3d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:30.334836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214acd9-6711-4abc-8e8a-e2316a4f23ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:30.336826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214acd9-6711-4abc-8e8a-e2316a4f23ef None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:30.337323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214acd9-6711-4abc-8e8a-e2316a4f23ef None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:30.337903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214acd9-6711-4abc-8e8a-e2316a4f23ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:30.375437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0255a9-d82f-4f9f-ae33-e1cd7e87ce68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:30.382101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0255a9-d82f-4f9f-ae33-e1cd7e87ce68 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:30.382396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0255a9-d82f-4f9f-ae33-e1cd7e87ce68 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:30.382683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0255a9-d82f-4f9f-ae33-e1cd7e87ce68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:30.383541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0255a9-d82f-4f9f-ae33-e1cd7e87ce68 None admin] RBAC: Adding query filter params (role.id=af99020fdd8b4a4e93e3b913d49e9cf8, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c, user.id=c497a16afc3a433088dca5c4ab1dd700) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:30.383860 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0255a9-d82f-4f9f-ae33-e1cd7e87ce68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:30.385316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0255a9-d82f-4f9f-ae33-e1cd7e87ce68 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:30.399607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 99/205] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:30 2022] GET /identity/v3/role_assignments?user.id=c497a16afc3a433088dca5c4ab1dd700&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=af99020fdd8b4a4e93e3b913d49e9cf8 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:30.430086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214acd9-6711-4abc-8e8a-e2316a4f23ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:30.431589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214acd9-6711-4abc-8e8a-e2316a4f23ef None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:30.537792 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 107/206] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:23:30.543994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0255a9-d82f-4f9f-ae33-e1cd7e87ce68 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:30.628822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:30.655777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0255a9-d82f-4f9f-ae33-e1cd7e87ce68 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:30.762594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5636afe-1bed-41fe-82a3-5d65117bdfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:30.763737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5636afe-1bed-41fe-82a3-5d65117bdfb3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:30.764160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5636afe-1bed-41fe-82a3-5d65117bdfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:30.764572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5636afe-1bed-41fe-82a3-5d65117bdfb3 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:30.770441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5636afe-1bed-41fe-82a3-5d65117bdfb3 None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:30.772168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5636afe-1bed-41fe-82a3-5d65117bdfb3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:30.774211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 100/207] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:30 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:30.780164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214acd9-6711-4abc-8e8a-e2316a4f23ef None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:30.803813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:30.925124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214acd9-6711-4abc-8e8a-e2316a4f23ef None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:30.976705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4eee0-8d1b-47b4-a92e-0a30e6f22238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:30.977826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4eee0-8d1b-47b4-a92e-0a30e6f22238 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:30.978314 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4eee0-8d1b-47b4-a92e-0a30e6f22238 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:30.978790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4eee0-8d1b-47b4-a92e-0a30e6f22238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:30.979813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4eee0-8d1b-47b4-a92e-0a30e6f22238 None admin] RBAC: Adding query filter params (role.id=35bddef47fa34f62be6f49ddad1b12aa, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14, user.id=edef234764cd4cee94a25f79c1acebb0) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:30.980324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4eee0-8d1b-47b4-a92e-0a30e6f22238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:30.982006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4eee0-8d1b-47b4-a92e-0a30e6f22238 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:30.994575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 108/208] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:30 2022] GET /identity/v3/role_assignments?user.id=edef234764cd4cee94a25f79c1acebb0&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=35bddef47fa34f62be6f49ddad1b12aa => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:31.101017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3acd8-bdf5-4502-886c-6bfef7f0ca0c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:31.101300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3acd8-bdf5-4502-886c-6bfef7f0ca0c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:31.101801 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3acd8-bdf5-4502-886c-6bfef7f0ca0c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:31.103379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 101/209] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:31.108796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959afa1-909c-4c2e-9a99-54098a5d1828 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:31.109090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959afa1-909c-4c2e-9a99-54098a5d1828 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:31.109935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959afa1-909c-4c2e-9a99-54098a5d1828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:31.140278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7959afa1-909c-4c2e-9a99-54098a5d1828 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:31.141584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7959afa1-909c-4c2e-9a99-54098a5d1828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:31.243907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 109/210] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:31.274334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3acd8-bdf5-4502-886c-6bfef7f0ca0c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:31.375622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdba44-afdf-4d00-8473-10cb5c50a175 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:31.376267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdba44-afdf-4d00-8473-10cb5c50a175 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:31.376773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdba44-afdf-4d00-8473-10cb5c50a175 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:31.378394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 110/211] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:31.383746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19b134-ab04-4218-b4cd-b0f5db79d9ca None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:31.384274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19b134-ab04-4218-b4cd-b0f5db79d9ca None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:31.384751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19b134-ab04-4218-b4cd-b0f5db79d9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:31.395081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3acd8-bdf5-4502-886c-6bfef7f0ca0c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:31.411623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-eb19b134-ab04-4218-b4cd-b0f5db79d9ca None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:31.413300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-eb19b134-ab04-4218-b4cd-b0f5db79d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:31.424229 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:31.440471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c64398-d512-49eb-b321-4c5e8f3b5ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:31.441495 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c64398-d512-49eb-b321-4c5e8f3b5ceb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:31.442053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c64398-d512-49eb-b321-4c5e8f3b5ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:31.442477 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c64398-d512-49eb-b321-4c5e8f3b5ceb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:31.443846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c64398-d512-49eb-b321-4c5e8f3b5ceb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:31.445473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c64398-d512-49eb-b321-4c5e8f3b5ceb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:31.447641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 102/212] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:31.453149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c64398-d512-49eb-b321-4c5e8f3b5ceb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:31.468166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:31.499530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 111/213] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:31.521976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19b134-ab04-4218-b4cd-b0f5db79d9ca None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:31.568883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c64398-d512-49eb-b321-4c5e8f3b5ceb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:31.615205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7869b-e6a9-423f-a5fb-388936876000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:31.616179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7869b-e6a9-423f-a5fb-388936876000 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:31.616702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7869b-e6a9-423f-a5fb-388936876000 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:31.623421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7869b-e6a9-423f-a5fb-388936876000 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:31.623421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7869b-e6a9-423f-a5fb-388936876000 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:31.623421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7869b-e6a9-423f-a5fb-388936876000 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:31.629715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19b134-ab04-4218-b4cd-b0f5db79d9ca None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:31.666710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee89a5-eee5-4ab4-aa2a-7f56b009c2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:31.668646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee89a5-eee5-4ab4-aa2a-7f56b009c2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:31.668933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee89a5-eee5-4ab4-aa2a-7f56b009c2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:31.669300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee89a5-eee5-4ab4-aa2a-7f56b009c2a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:31.681102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee89a5-eee5-4ab4-aa2a-7f56b009c2a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9aee89a5-eee5-4ab4-aa2a-7f56b009c2a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:31.689049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:31.690193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:31.691181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 112/214] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:31.696143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee89a5-eee5-4ab4-aa2a-7f56b009c2a0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:31.699281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:31.706257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 103/215] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:23:31 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:31.826183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee89a5-eee5-4ab4-aa2a-7f56b009c2a0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:31.867080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90276a8-9ea6-4c48-958c-6e7c702c5d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:31.868174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90276a8-9ea6-4c48-958c-6e7c702c5d26 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:31.868660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90276a8-9ea6-4c48-958c-6e7c702c5d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:31.869153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90276a8-9ea6-4c48-958c-6e7c702c5d26 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:31.870166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90276a8-9ea6-4c48-958c-6e7c702c5d26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:31.870675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90276a8-9ea6-4c48-958c-6e7c702c5d26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:31.872586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90276a8-9ea6-4c48-958c-6e7c702c5d26 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:31.882884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 113/216] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:31.892651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7869b-e6a9-423f-a5fb-388936876000 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:31.965315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:32.001270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7869b-e6a9-423f-a5fb-388936876000 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:32.037956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b1593-8933-4555-a087-f49351ddbb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:32.038847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1593-8933-4555-a087-f49351ddbb93 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:32.039131 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1593-8933-4555-a087-f49351ddbb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:32.039403 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b1593-8933-4555-a087-f49351ddbb93 None admin] PATH_INFO: `/v3/users/e84e4a936b7445e88f8b36d2f41da73e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:32.054286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b1593-8933-4555-a087-f49351ddbb93 None admin] RBAC: Authorizing `identity:get_user(user_id=e84e4a936b7445e88f8b36d2f41da73e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:32.055830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b1593-8933-4555-a087-f49351ddbb93 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:32.057854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 104/217] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:31 2022] GET /identity/v3/users/e84e4a936b7445e88f8b36d2f41da73e => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:32.063283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90276a8-9ea6-4c48-958c-6e7c702c5d26 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:32.146636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:32.193018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90276a8-9ea6-4c48-958c-6e7c702c5d26 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:32.229801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec8f7c-a173-4bed-a15f-9c20e29b8c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:32.230511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec8f7c-a173-4bed-a15f-9c20e29b8c47 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:32.230793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec8f7c-a173-4bed-a15f-9c20e29b8c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:32.231065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec8f7c-a173-4bed-a15f-9c20e29b8c47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:32.329829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec8f7c-a173-4bed-a15f-9c20e29b8c47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:32.331292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec8f7c-a173-4bed-a15f-9c20e29b8c47 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:32.395826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872750-7438-4fcd-a372-0cccc7f22d78 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:32.396140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872750-7438-4fcd-a372-0cccc7f22d78 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:32.396403 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9872750-7438-4fcd-a372-0cccc7f22d78 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:32.398046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 105/218] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:32.402883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca9fbd-ae67-4e0a-8342-3219f52e6388 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:32.403534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca9fbd-ae67-4e0a-8342-3219f52e6388 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:32.403818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca9fbd-ae67-4e0a-8342-3219f52e6388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:32.424130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-daca9fbd-ae67-4e0a-8342-3219f52e6388 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:32.425384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-daca9fbd-ae67-4e0a-8342-3219f52e6388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:32.438906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:32.503735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 114/219] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:32.514722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec8f7c-a173-4bed-a15f-9c20e29b8c47 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:32.542378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 106/220] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:32.568512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca9fbd-ae67-4e0a-8342-3219f52e6388 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:32.673847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:32.726328 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec8f7c-a173-4bed-a15f-9c20e29b8c47 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:32.762322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca9fbd-ae67-4e0a-8342-3219f52e6388 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:32.793691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d07ca-3a0c-46a5-81a7-ac538e39058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:32.793691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d07ca-3a0c-46a5-81a7-ac538e39058a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:32.793691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d07ca-3a0c-46a5-81a7-ac538e39058a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:32.793691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d07ca-3a0c-46a5-81a7-ac538e39058a None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:32.794160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d07ca-3a0c-46a5-81a7-ac538e39058a None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:32.794160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d07ca-3a0c-46a5-81a7-ac538e39058a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:32.801154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 115/221] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:32 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:32.817523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d07ca-3a0c-46a5-81a7-ac538e39058a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:32.819789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf2a25-f439-4249-a326-83b95731f4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:32.820826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf2a25-f439-4249-a326-83b95731f4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:32.821206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf2a25-f439-4249-a326-83b95731f4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:32.825582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf2a25-f439-4249-a326-83b95731f4a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:32.863118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf2a25-f439-4249-a326-83b95731f4a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:32.863791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-edcf2a25-f439-4249-a326-83b95731f4a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:32.871668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:32.872587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:32.873352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 107/222] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:23:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:32.880379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf2a25-f439-4249-a326-83b95731f4a6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:32.963541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d07ca-3a0c-46a5-81a7-ac538e39058a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:32.995263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf2a25-f439-4249-a326-83b95731f4a6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:33.005925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96abb3-ee39-4f0f-a996-16a6bd67a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:33.006639 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96abb3-ee39-4f0f-a996-16a6bd67a806 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:33.006962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96abb3-ee39-4f0f-a996-16a6bd67a806 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:33.007242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96abb3-ee39-4f0f-a996-16a6bd67a806 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:33.008087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96abb3-ee39-4f0f-a996-16a6bd67a806 None admin] RBAC: Adding query filter params (role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c, user.id=e84e4a936b7445e88f8b36d2f41da73e) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:33.008402 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96abb3-ee39-4f0f-a996-16a6bd67a806 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:33.010636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96abb3-ee39-4f0f-a996-16a6bd67a806 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:33.014457 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:33.025709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 116/223] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:32 2022] GET /identity/v3/role_assignments?user.id=e84e4a936b7445e88f8b36d2f41da73e&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:33.025709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770024fa-1d30-4e18-8a60-ab74191ee729 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:33.025709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770024fa-1d30-4e18-8a60-ab74191ee729 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:33.025709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770024fa-1d30-4e18-8a60-ab74191ee729 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:33.025709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 117/224] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:33.028555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a69b7-f568-4eb6-bbe7-2621a11cdf83 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:33.028851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a69b7-f568-4eb6-bbe7-2621a11cdf83 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:33.029198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a69b7-f568-4eb6-bbe7-2621a11cdf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:33.050642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a91a69b7-f568-4eb6-bbe7-2621a11cdf83 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:33.053531 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a91a69b7-f568-4eb6-bbe7-2621a11cdf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:33.059052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731663f-20ac-4128-b0aa-2ce78200a512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:33.060080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731663f-20ac-4128-b0aa-2ce78200a512 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:33.060567 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731663f-20ac-4128-b0aa-2ce78200a512 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:33.061040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731663f-20ac-4128-b0aa-2ce78200a512 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:33.062184 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731663f-20ac-4128-b0aa-2ce78200a512 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:33.063307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731663f-20ac-4128-b0aa-2ce78200a512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:33.070736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0731663f-20ac-4128-b0aa-2ce78200a512 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:33.089556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 108/225] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:33.096071 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731663f-20ac-4128-b0aa-2ce78200a512 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:33.179207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 118/226] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:33.206415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a69b7-f568-4eb6-bbe7-2621a11cdf83 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:33.253425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:33.254812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731663f-20ac-4128-b0aa-2ce78200a512 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:33.296526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c569e4c-9528-4e96-8d87-dc87c474c36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:33.297971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569e4c-9528-4e96-8d87-dc87c474c36a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:33.298261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569e4c-9528-4e96-8d87-dc87c474c36a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:33.298540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c569e4c-9528-4e96-8d87-dc87c474c36a None admin] PATH_INFO: `/v3/users/c497a16afc3a433088dca5c4ab1dd700` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:33.301167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c569e4c-9528-4e96-8d87-dc87c474c36a None admin] RBAC: Authorizing `identity:get_user(user_id=c497a16afc3a433088dca5c4ab1dd700)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:33.302689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c569e4c-9528-4e96-8d87-dc87c474c36a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:33.305800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 109/227] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:33 2022] GET /identity/v3/users/c497a16afc3a433088dca5c4ab1dd700 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:33.310891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c569e4c-9528-4e96-8d87-dc87c474c36a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:33.395735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:33.400380 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a69b7-f568-4eb6-bbe7-2621a11cdf83 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:33.471630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026d481-cc7c-4268-b857-5bc7cad7043a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:33.474053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026d481-cc7c-4268-b857-5bc7cad7043a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:33.475445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026d481-cc7c-4268-b857-5bc7cad7043a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:33.475967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026d481-cc7c-4268-b857-5bc7cad7043a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:33.498246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026d481-cc7c-4268-b857-5bc7cad7043a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:33.507949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c569e4c-9528-4e96-8d87-dc87c474c36a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6026d481-cc7c-4268-b857-5bc7cad7043a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:33.512048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:33.513245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:33.514029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:33.522034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 119/228] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:33.530661 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026d481-cc7c-4268-b857-5bc7cad7043a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:33.566699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0bda2-4593-4c0f-b88d-5dd89e3dbc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:33.567651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0bda2-4593-4c0f-b88d-5dd89e3dbc29 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:33.567951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0bda2-4593-4c0f-b88d-5dd89e3dbc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:33.568237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f0bda2-4593-4c0f-b88d-5dd89e3dbc29 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:33.570465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0bda2-4593-4c0f-b88d-5dd89e3dbc29 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:33.571994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f0bda2-4593-4c0f-b88d-5dd89e3dbc29 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:33.574174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 110/229] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:33 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:33.581921 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0bda2-4593-4c0f-b88d-5dd89e3dbc29 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:33.639770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:33.656075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026d481-cc7c-4268-b857-5bc7cad7043a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:33.694391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b79297-1d42-4dda-9e8f-eeec3103076e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:33.695476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b79297-1d42-4dda-9e8f-eeec3103076e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:33.695971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b79297-1d42-4dda-9e8f-eeec3103076e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:33.696475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b79297-1d42-4dda-9e8f-eeec3103076e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:33.697433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b79297-1d42-4dda-9e8f-eeec3103076e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:33.697976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b79297-1d42-4dda-9e8f-eeec3103076e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:33.699559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b79297-1d42-4dda-9e8f-eeec3103076e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:33.709218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 120/230] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:33.732844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b79297-1d42-4dda-9e8f-eeec3103076e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:33.736714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f0bda2-4593-4c0f-b88d-5dd89e3dbc29 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:33.768211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:33.815393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ddaaa-3dba-4c2c-8060-5cfd50cf043b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:33.815856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ddaaa-3dba-4c2c-8060-5cfd50cf043b None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:33.816139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ddaaa-3dba-4c2c-8060-5cfd50cf043b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:33.816412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ddaaa-3dba-4c2c-8060-5cfd50cf043b None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/users/c497a16afc3a433088dca5c4ab1dd700/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:33.830676 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ddaaa-3dba-4c2c-8060-5cfd50cf043b None admin] RBAC: Authorizing `identity:create_grant(project_id=4a070bf9ade14aafa5a6b04292868a5c, user_id=c497a16afc3a433088dca5c4ab1dd700, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:33.832144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ddaaa-3dba-4c2c-8060-5cfd50cf043b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:33.849251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b79297-1d42-4dda-9e8f-eeec3103076e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:33.886707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6a023-254c-405b-9d33-a863e42a9591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:33.887947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a023-254c-405b-9d33-a863e42a9591 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:33.888440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a023-254c-405b-9d33-a863e42a9591 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:33.888917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6a023-254c-405b-9d33-a863e42a9591 None admin] PATH_INFO: `/v3/users/c497a16afc3a433088dca5c4ab1dd700` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:33.890377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6a023-254c-405b-9d33-a863e42a9591 None admin] RBAC: Authorizing `identity:get_user(user_id=c497a16afc3a433088dca5c4ab1dd700)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:33.892646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6a023-254c-405b-9d33-a863e42a9591 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:33.894876 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 121/231] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:33 2022] GET /identity/v3/users/c497a16afc3a433088dca5c4ab1dd700 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:33.900385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6a023-254c-405b-9d33-a863e42a9591 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:33.920310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:33.942708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 111/232] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:23:33 2022] PUT /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/users/c497a16afc3a433088dca5c4ab1dd700/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:23:34.035977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6a023-254c-405b-9d33-a863e42a9591 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:34.079685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed6013-6c30-4808-8d99-845a5f3a4b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:34.080587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6013-6c30-4808-8d99-845a5f3a4b6d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.080887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6013-6c30-4808-8d99-845a5f3a4b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.081172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed6013-6c30-4808-8d99-845a5f3a4b6d None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.082451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed6013-6c30-4808-8d99-845a5f3a4b6d None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:34.084104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed6013-6c30-4808-8d99-845a5f3a4b6d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:34.086245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 122/233] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:33 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:34.094808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ddaaa-3dba-4c2c-8060-5cfd50cf043b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:34.237077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ddaaa-3dba-4c2c-8060-5cfd50cf043b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:34.273315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed369f41-ffd0-4b42-94c0-4f7d1efcf995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:34.274573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed369f41-ffd0-4b42-94c0-4f7d1efcf995 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.275069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed369f41-ffd0-4b42-94c0-4f7d1efcf995 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.275588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed369f41-ffd0-4b42-94c0-4f7d1efcf995 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/users/c497a16afc3a433088dca5c4ab1dd700/roles/af99020fdd8b4a4e93e3b913d49e9cf8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.278255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed369f41-ffd0-4b42-94c0-4f7d1efcf995 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a070bf9ade14aafa5a6b04292868a5c, user_id=c497a16afc3a433088dca5c4ab1dd700, role_id=af99020fdd8b4a4e93e3b913d49e9cf8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:34.279943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed369f41-ffd0-4b42-94c0-4f7d1efcf995 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:34.395153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ab5f3-1ec5-4ba9-9f69-856af4be8db5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.395508 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ab5f3-1ec5-4ba9-9f69-856af4be8db5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.395717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2ab5f3-1ec5-4ba9-9f69-856af4be8db5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.397089 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 123/234] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:34.402073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e10b8e-8e91-4323-a9f3-5ba791f8f226 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.402360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e10b8e-8e91-4323-a9f3-5ba791f8f226 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.402641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e10b8e-8e91-4323-a9f3-5ba791f8f226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.418306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 112/235] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:23:34 2022] PUT /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/users/c497a16afc3a433088dca5c4ab1dd700/roles/af99020fdd8b4a4e93e3b913d49e9cf8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:34.423555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d1e10b8e-8e91-4323-a9f3-5ba791f8f226 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:34.424802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d1e10b8e-8e91-4323-a9f3-5ba791f8f226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:34.522240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 124/236] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:34.560623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e10b8e-8e91-4323-a9f3-5ba791f8f226 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:34.561475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f984f-b442-4862-9e76-9bc8c88194fb None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.562019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f984f-b442-4862-9e76-9bc8c88194fb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.562305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f984f-b442-4862-9e76-9bc8c88194fb None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.565053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 113/237] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:34.572525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ebc13-48c1-43f7-9af4-854713ca2c00 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.573285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ebc13-48c1-43f7-9af4-854713ca2c00 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.573583 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ebc13-48c1-43f7-9af4-854713ca2c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.580106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:34.595604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2f0ebc13-48c1-43f7-9af4-854713ca2c00 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:34.597139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2f0ebc13-48c1-43f7-9af4-854713ca2c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:34.632900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:34.717266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 114/238] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:34.740615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e10b8e-8e91-4323-a9f3-5ba791f8f226 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:34.765397 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ebc13-48c1-43f7-9af4-854713ca2c00 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:34.782835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea2389-14ae-4f35-aab6-3ff6cf8deff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:34.783639 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea2389-14ae-4f35-aab6-3ff6cf8deff1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.783922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea2389-14ae-4f35-aab6-3ff6cf8deff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.784196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea2389-14ae-4f35-aab6-3ff6cf8deff1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.798258 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea2389-14ae-4f35-aab6-3ff6cf8deff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4aea2389-14ae-4f35-aab6-3ff6cf8deff1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:34.805962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:34.806812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:34.807565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:34.811971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 125/239] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:34.813758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea2389-14ae-4f35-aab6-3ff6cf8deff1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:34.898915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ebc13-48c1-43f7-9af4-854713ca2c00 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:34.932629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:34.941415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923a0f7-2347-40fc-9928-9cef86926402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:34.942263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923a0f7-2347-40fc-9928-9cef86926402 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:34.942712 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923a0f7-2347-40fc-9928-9cef86926402 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:34.945611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923a0f7-2347-40fc-9928-9cef86926402 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:34.945611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923a0f7-2347-40fc-9928-9cef86926402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:34.945808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923a0f7-2347-40fc-9928-9cef86926402 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:34.948007 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 115/240] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:34.953698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923a0f7-2347-40fc-9928-9cef86926402 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:34.992527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:34.993764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea2389-14ae-4f35-aab6-3ff6cf8deff1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:35.071266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8516ee-8305-4eb8-981e-f46678eb0697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:35.075294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923a0f7-2347-40fc-9928-9cef86926402 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:35.089829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8516ee-8305-4eb8-981e-f46678eb0697 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:35.090249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8516ee-8305-4eb8-981e-f46678eb0697 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:35.090539 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8516ee-8305-4eb8-981e-f46678eb0697 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.091358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8516ee-8305-4eb8-981e-f46678eb0697 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:35.091669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8516ee-8305-4eb8-981e-f46678eb0697 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:35.093086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8516ee-8305-4eb8-981e-f46678eb0697 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:35.107806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 126/241] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:35.113098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d19f3-24fd-450f-9926-c4c636fbd98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:35.113881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d19f3-24fd-450f-9926-c4c636fbd98a None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:35.114174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d19f3-24fd-450f-9926-c4c636fbd98a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:35.114452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d19f3-24fd-450f-9926-c4c636fbd98a None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.114632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8516ee-8305-4eb8-981e-f46678eb0697 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:35.115295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d19f3-24fd-450f-9926-c4c636fbd98a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:35.116760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d19f3-24fd-450f-9926-c4c636fbd98a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:35.240132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8516ee-8305-4eb8-981e-f46678eb0697 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:35.245496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 116/242] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:23:34 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:35.281185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918ab8-aea2-4333-ba5f-d1bd014b6c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:35.282317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918ab8-aea2-4333-ba5f-d1bd014b6c5c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:35.282602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918ab8-aea2-4333-ba5f-d1bd014b6c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:35.282882 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37918ab8-aea2-4333-ba5f-d1bd014b6c5c None admin] PATH_INFO: `/v3/users/8b7154a229e84774ad89986848633ead` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.287406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:35.299474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918ab8-aea2-4333-ba5f-d1bd014b6c5c None admin] RBAC: Authorizing `identity:get_user(user_id=8b7154a229e84774ad89986848633ead)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:35.300992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37918ab8-aea2-4333-ba5f-d1bd014b6c5c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:35.303003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 127/243] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:35 2022] GET /identity/v3/users/8b7154a229e84774ad89986848633ead => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:35.308915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d19f3-24fd-450f-9926-c4c636fbd98a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:35.444838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:35.460787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d19f3-24fd-450f-9926-c4c636fbd98a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:35.500100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ae58b-1fb8-42e4-be77-36c650f70e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:35.500687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ae58b-1fb8-42e4-be77-36c650f70e3a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:35.500999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ae58b-1fb8-42e4-be77-36c650f70e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:35.501301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ae58b-1fb8-42e4-be77-36c650f70e3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.583254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ae58b-1fb8-42e4-be77-36c650f70e3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:35.584791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ae58b-1fb8-42e4-be77-36c650f70e3a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:35.682032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:35.697319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 117/244] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:35.702767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918ab8-aea2-4333-ba5f-d1bd014b6c5c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:35.825625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404046c-de8d-4d1b-a043-eef004634d5a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:35.826767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404046c-de8d-4d1b-a043-eef004634d5a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:35.827055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404046c-de8d-4d1b-a043-eef004634d5a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.828961 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 118/245] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:35.839177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca3805-bedc-4876-a570-81d126a5bbb2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:35.839767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca3805-bedc-4876-a570-81d126a5bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:35.840277 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca3805-bedc-4876-a570-81d126a5bbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.860866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37918ab8-aea2-4333-ba5f-d1bd014b6c5c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:35.866784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-45ca3805-bedc-4876-a570-81d126a5bbb2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:35.868383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-45ca3805-bedc-4876-a570-81d126a5bbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:35.909316 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47d6aa-bf87-428c-a3d6-97c0b92b6102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:35.910134 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d6aa-bf87-428c-a3d6-97c0b92b6102 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:35.910570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d6aa-bf87-428c-a3d6-97c0b92b6102 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:35.910935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47d6aa-bf87-428c-a3d6-97c0b92b6102 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:35.912455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47d6aa-bf87-428c-a3d6-97c0b92b6102 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:35.914324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47d6aa-bf87-428c-a3d6-97c0b92b6102 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:35.916922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 128/246] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:35 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:35.923118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47d6aa-bf87-428c-a3d6-97c0b92b6102 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:35.969174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 119/247] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:35.993561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca3805-bedc-4876-a570-81d126a5bbb2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.001497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:36.052774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47d6aa-bf87-428c-a3d6-97c0b92b6102 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:36.097125 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34ce5f-9e6a-46e6-b68d-507730e5a888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:36.097825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34ce5f-9e6a-46e6-b68d-507730e5a888 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.098332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34ce5f-9e6a-46e6-b68d-507730e5a888 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.098619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34ce5f-9e6a-46e6-b68d-507730e5a888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.099465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34ce5f-9e6a-46e6-b68d-507730e5a888 None admin] RBAC: Adding query filter params (role.id=35bddef47fa34f62be6f49ddad1b12aa, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c, user.id=8b7154a229e84774ad89986848633ead) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:36.099784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34ce5f-9e6a-46e6-b68d-507730e5a888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:36.101450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34ce5f-9e6a-46e6-b68d-507730e5a888 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:36.109473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 129/248] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:35 2022] GET /identity/v3/role_assignments?user.id=8b7154a229e84774ad89986848633ead&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=35bddef47fa34f62be6f49ddad1b12aa => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:36.186198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca3805-bedc-4876-a570-81d126a5bbb2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:36.216572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:36.242701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31a8ff-a2c5-4ff9-b543-42b7f12ba261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:36.243511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31a8ff-a2c5-4ff9-b543-42b7f12ba261 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.243793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31a8ff-a2c5-4ff9-b543-42b7f12ba261 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.244065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31a8ff-a2c5-4ff9-b543-42b7f12ba261 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.260369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31a8ff-a2c5-4ff9-b543-42b7f12ba261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2d31a8ff-a2c5-4ff9-b543-42b7f12ba261 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:36.269028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:36.269983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:36.270763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 120/249] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:36.276341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34ce5f-9e6a-46e6-b68d-507730e5a888 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.406752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34ce5f-9e6a-46e6-b68d-507730e5a888 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:36.447788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:36.463278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c78a6b2-9363-45cf-af9e-f9ee704c53e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:36.463985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78a6b2-9363-45cf-af9e-f9ee704c53e9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.464274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78a6b2-9363-45cf-af9e-f9ee704c53e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.464555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c78a6b2-9363-45cf-af9e-f9ee704c53e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.465336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78a6b2-9363-45cf-af9e-f9ee704c53e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:36.465641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78a6b2-9363-45cf-af9e-f9ee704c53e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:36.467087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c78a6b2-9363-45cf-af9e-f9ee704c53e9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:36.478083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 130/250] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:36.486750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31a8ff-a2c5-4ff9-b543-42b7f12ba261 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.634674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31a8ff-a2c5-4ff9-b543-42b7f12ba261 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:36.663004 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e2176-77a8-4f1b-a519-7740bffbf619 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.663293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e2176-77a8-4f1b-a519-7740bffbf619 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.663480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e2176-77a8-4f1b-a519-7740bffbf619 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.665121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 131/251] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:36.675075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1cc8a-aca8-479a-9b1e-d674aeb2ba43 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.675367 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1cc8a-aca8-479a-9b1e-d674aeb2ba43 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.675652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1cc8a-aca8-479a-9b1e-d674aeb2ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.707018 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d72252-a200-4288-a14d-9e50c1f36e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:36.708304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d72252-a200-4288-a14d-9e50c1f36e2c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:36.708785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d72252-a200-4288-a14d-9e50c1f36e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:36.709256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d72252-a200-4288-a14d-9e50c1f36e2c None admin] PATH_INFO: `/v3/users/e84e4a936b7445e88f8b36d2f41da73e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:36.710929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-abf1cc8a-aca8-479a-9b1e-d674aeb2ba43 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:36.712093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d72252-a200-4288-a14d-9e50c1f36e2c None admin] RBAC: Authorizing `identity:get_user(user_id=e84e4a936b7445e88f8b36d2f41da73e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:36.713766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d72252-a200-4288-a14d-9e50c1f36e2c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:36.715193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-abf1cc8a-aca8-479a-9b1e-d674aeb2ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:36.725714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 121/252] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/users/e84e4a936b7445e88f8b36d2f41da73e => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:36.729110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d72252-a200-4288-a14d-9e50c1f36e2c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.830148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:36.897844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 132/253] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:36.936337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1cc8a-aca8-479a-9b1e-d674aeb2ba43 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:36.942191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d72252-a200-4288-a14d-9e50c1f36e2c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.012878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759a402-1482-434a-84b9-a93bc07a5bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.013781 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a402-1482-434a-84b9-a93bc07a5bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.014237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a402-1482-434a-84b9-a93bc07a5bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.014690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a402-1482-434a-84b9-a93bc07a5bb5 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.016086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759a402-1482-434a-84b9-a93bc07a5bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.018208 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759a402-1482-434a-84b9-a93bc07a5bb5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.020659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 122/254] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:37.027099 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759a402-1482-434a-84b9-a93bc07a5bb5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.162865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1cc8a-aca8-479a-9b1e-d674aeb2ba43 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.194843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.210814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf94de-a332-42a6-bf61-64b7c9e11c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.212171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf94de-a332-42a6-bf61-64b7c9e11c45 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.213047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf94de-a332-42a6-bf61-64b7c9e11c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.213471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf94de-a332-42a6-bf61-64b7c9e11c45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.228575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf94de-a332-42a6-bf61-64b7c9e11c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6aaf94de-a332-42a6-bf61-64b7c9e11c45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:37.237606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:37.238656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:37.239493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:37.242130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 133/255] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:23:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:37.245124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759a402-1482-434a-84b9-a93bc07a5bb5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.249363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf94de-a332-42a6-bf61-64b7c9e11c45 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.264794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.305554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4940-0fd7-40c8-b520-180881f6d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.306417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4940-0fd7-40c8-b520-180881f6d67d None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.306706 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4940-0fd7-40c8-b520-180881f6d67d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.306988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b4940-0fd7-40c8-b520-180881f6d67d None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/users/e84e4a936b7445e88f8b36d2f41da73e/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.311439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4940-0fd7-40c8-b520-180881f6d67d None admin] RBAC: Authorizing `identity:create_grant(project_id=4a070bf9ade14aafa5a6b04292868a5c, user_id=e84e4a936b7445e88f8b36d2f41da73e, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.312957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b4940-0fd7-40c8-b520-180881f6d67d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.372050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 123/256] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:23:37 2022] PUT /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/users/e84e4a936b7445e88f8b36d2f41da73e/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:37.409439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf94de-a332-42a6-bf61-64b7c9e11c45 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.463309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc73fb26-de7a-4063-abda-7a989430c7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.463934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73fb26-de7a-4063-abda-7a989430c7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.464225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73fb26-de7a-4063-abda-7a989430c7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.464507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73fb26-de7a-4063-abda-7a989430c7a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.465277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73fb26-de7a-4063-abda-7a989430c7a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:37.465590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73fb26-de7a-4063-abda-7a989430c7a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.467027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc73fb26-de7a-4063-abda-7a989430c7a3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.476334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 134/257] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:37.482262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4940-0fd7-40c8-b520-180881f6d67d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.606533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b4940-0fd7-40c8-b520-180881f6d67d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.613732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f92a49-ca47-4cc2-8fa2-b50a3d71f07b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.614329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f92a49-ca47-4cc2-8fa2-b50a3d71f07b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.620468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f92a49-ca47-4cc2-8fa2-b50a3d71f07b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.620468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 135/258] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:37.622637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474c27-db89-4119-a176-dd118d2e3277 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.623129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474c27-db89-4119-a176-dd118d2e3277 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.623595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474c27-db89-4119-a176-dd118d2e3277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.642732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b8474c27-db89-4119-a176-dd118d2e3277 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:37.644509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b8474c27-db89-4119-a176-dd118d2e3277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:37.665701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffb5ad-fc30-4693-adde-820517eeea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.665701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffb5ad-fc30-4693-adde-820517eeea74 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.665701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffb5ad-fc30-4693-adde-820517eeea74 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.665701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ffb5ad-fc30-4693-adde-820517eeea74 None admin] PATH_INFO: `/v3/users/c497a16afc3a433088dca5c4ab1dd700` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.666125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffb5ad-fc30-4693-adde-820517eeea74 None admin] RBAC: Authorizing `identity:get_user(user_id=c497a16afc3a433088dca5c4ab1dd700)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.666125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ffb5ad-fc30-4693-adde-820517eeea74 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.666125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 124/259] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/users/c497a16afc3a433088dca5c4ab1dd700 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:37.679155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffb5ad-fc30-4693-adde-820517eeea74 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.712066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.735389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.752807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 136/260] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:37.792897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474c27-db89-4119-a176-dd118d2e3277 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:37.795769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ffb5ad-fc30-4693-adde-820517eeea74 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:37.831059 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c45d5-e858-4c8b-97f6-4ccfc0fbe7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:37.831839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c45d5-e858-4c8b-97f6-4ccfc0fbe7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:37.832051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c45d5-e858-4c8b-97f6-4ccfc0fbe7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:37.832335 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c45d5-e858-4c8b-97f6-4ccfc0fbe7c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:37.903691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c45d5-e858-4c8b-97f6-4ccfc0fbe7c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:37.905167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c45d5-e858-4c8b-97f6-4ccfc0fbe7c6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:37.954027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:37.985073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474c27-db89-4119-a176-dd118d2e3277 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.014744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 125/261] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:23:38.019807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c45d5-e858-4c8b-97f6-4ccfc0fbe7c6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.048523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da2215-1fcc-4ee0-a9cb-6ea114babdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.049654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2215-1fcc-4ee0-a9cb-6ea114babdda None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.050131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2215-1fcc-4ee0-a9cb-6ea114babdda None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.050547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da2215-1fcc-4ee0-a9cb-6ea114babdda None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.084794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da2215-1fcc-4ee0-a9cb-6ea114babdda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a7da2215-1fcc-4ee0-a9cb-6ea114babdda None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:38.094230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:38.095100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:38.095958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:38.099561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 137/262] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:38.110532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da2215-1fcc-4ee0-a9cb-6ea114babdda None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.170178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.213548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c45d5-e858-4c8b-97f6-4ccfc0fbe7c6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.281640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfc6f-65c8-4547-ab09-a41be1b55cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfc6f-65c8-4547-ab09-a41be1b55cfc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.282733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfc6f-65c8-4547-ab09-a41be1b55cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.283007 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfc6f-65c8-4547-ab09-a41be1b55cfc None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.285560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfc6f-65c8-4547-ab09-a41be1b55cfc None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.287027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfc6f-65c8-4547-ab09-a41be1b55cfc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.288709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 126/263] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:38.298687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfc6f-65c8-4547-ab09-a41be1b55cfc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.304280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da2215-1fcc-4ee0-a9cb-6ea114babdda None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.321087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.380241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689b97e-6aa5-4166-8ad4-84f92a228c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.381355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b97e-6aa5-4166-8ad4-84f92a228c69 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.381858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b97e-6aa5-4166-8ad4-84f92a228c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.382326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b97e-6aa5-4166-8ad4-84f92a228c69 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.383323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689b97e-6aa5-4166-8ad4-84f92a228c69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:38.383839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689b97e-6aa5-4166-8ad4-84f92a228c69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.385449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689b97e-6aa5-4166-8ad4-84f92a228c69 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.404956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 138/264] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:38.418433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689b97e-6aa5-4166-8ad4-84f92a228c69 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.447853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfc6f-65c8-4547-ab09-a41be1b55cfc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.486203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44d1dd-90fe-40dd-9e0f-e39a2353e699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.487240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44d1dd-90fe-40dd-9e0f-e39a2353e699 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.487721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44d1dd-90fe-40dd-9e0f-e39a2353e699 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.488241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44d1dd-90fe-40dd-9e0f-e39a2353e699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.489281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44d1dd-90fe-40dd-9e0f-e39a2353e699 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c, user.id=c497a16afc3a433088dca5c4ab1dd700) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:38.489829 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44d1dd-90fe-40dd-9e0f-e39a2353e699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.491639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44d1dd-90fe-40dd-9e0f-e39a2353e699 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.499213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 127/265] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/role_assignments?user.id=c497a16afc3a433088dca5c4ab1dd700&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:38.549296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.562717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689b97e-6aa5-4166-8ad4-84f92a228c69 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.613284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cc7ce-f43a-478a-b00c-5aa166ba08fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.614401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc7ce-f43a-478a-b00c-5aa166ba08fe None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.614701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc7ce-f43a-478a-b00c-5aa166ba08fe None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.615031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cc7ce-f43a-478a-b00c-5aa166ba08fe None admin] PATH_INFO: `/v3/users/c497a16afc3a433088dca5c4ab1dd700` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.622643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cc7ce-f43a-478a-b00c-5aa166ba08fe None admin] RBAC: Authorizing `identity:get_user(user_id=c497a16afc3a433088dca5c4ab1dd700)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.641839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cc7ce-f43a-478a-b00c-5aa166ba08fe None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.641839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 139/266] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/users/c497a16afc3a433088dca5c4ab1dd700 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:38.642040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44d1dd-90fe-40dd-9e0f-e39a2353e699 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.661598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d89bc-5c99-499f-848d-dbaa43e8a33b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.661961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d89bc-5c99-499f-848d-dbaa43e8a33b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.662197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d89bc-5c99-499f-848d-dbaa43e8a33b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.665187 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 140/267] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:38.672575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eea8e4-1ccb-4fe7-8cda-176201254cab None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.672575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eea8e4-1ccb-4fe7-8cda-176201254cab None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.672575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eea8e4-1ccb-4fe7-8cda-176201254cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.689294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-88eea8e4-1ccb-4fe7-8cda-176201254cab None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:38.692420 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-88eea8e4-1ccb-4fe7-8cda-176201254cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:38.779766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:38.821961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 141/268] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:38.822437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44d1dd-90fe-40dd-9e0f-e39a2353e699 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:38.857401 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9c834-5f06-4504-89c2-02df9fba36c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:38.858172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c834-5f06-4504-89c2-02df9fba36c8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:38.858521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c834-5f06-4504-89c2-02df9fba36c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:38.858812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9c834-5f06-4504-89c2-02df9fba36c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:38.866124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eea8e4-1ccb-4fe7-8cda-176201254cab None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:38.938109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9c834-5f06-4504-89c2-02df9fba36c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:38.939595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9c834-5f06-4504-89c2-02df9fba36c8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:38.988019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:39.004593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eea8e4-1ccb-4fe7-8cda-176201254cab None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:39.040457 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:39.057391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957afff-e964-426e-ba37-c0e4b64340ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:39.058739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957afff-e964-426e-ba37-c0e4b64340ac None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.059242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957afff-e964-426e-ba37-c0e4b64340ac None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.059707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957afff-e964-426e-ba37-c0e4b64340ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.074881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 128/269] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:39.081965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9c834-5f06-4504-89c2-02df9fba36c8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:39.084444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957afff-e964-426e-ba37-c0e4b64340ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8957afff-e964-426e-ba37-c0e4b64340ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:39.094602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:39.095496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:39.096267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:39.100940 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 142/270] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:39.102475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957afff-e964-426e-ba37-c0e4b64340ac None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:39.208666 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9c834-5f06-4504-89c2-02df9fba36c8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:39.256946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cabc8-2671-4f20-8366-306e2885d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:39.258270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cabc8-2671-4f20-8366-306e2885d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.258761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cabc8-2671-4f20-8366-306e2885d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.259237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cabc8-2671-4f20-8366-306e2885d0e4 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.260664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cabc8-2671-4f20-8366-306e2885d0e4 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:39.262593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cabc8-2671-4f20-8366-306e2885d0e4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:39.265073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 129/271] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:39 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:39.271591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cabc8-2671-4f20-8366-306e2885d0e4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:39.308820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957afff-e964-426e-ba37-c0e4b64340ac None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:39.336444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:39.398930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cabc8-2671-4f20-8366-306e2885d0e4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:39.409937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269ae24-8f5b-43f8-a9f9-4493355f0112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:39.410897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269ae24-8f5b-43f8-a9f9-4493355f0112 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.411388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269ae24-8f5b-43f8-a9f9-4493355f0112 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.411863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269ae24-8f5b-43f8-a9f9-4493355f0112 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.412835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269ae24-8f5b-43f8-a9f9-4493355f0112 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:39.413340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269ae24-8f5b-43f8-a9f9-4493355f0112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:39.414979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269ae24-8f5b-43f8-a9f9-4493355f0112 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:39.431599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 143/272] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:39.438622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269ae24-8f5b-43f8-a9f9-4493355f0112 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:39.470411 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:39.476558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfce7c-4db8-4c75-a893-ffda530c5afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:39.477567 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfce7c-4db8-4c75-a893-ffda530c5afd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.478079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfce7c-4db8-4c75-a893-ffda530c5afd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.478549 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfce7c-4db8-4c75-a893-ffda530c5afd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.485196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfce7c-4db8-4c75-a893-ffda530c5afd None admin] RBAC: Adding query filter params (role.id=af99020fdd8b4a4e93e3b913d49e9cf8, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c, user.id=c497a16afc3a433088dca5c4ab1dd700) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:39.485196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfce7c-4db8-4c75-a893-ffda530c5afd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:39.485196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfce7c-4db8-4c75-a893-ffda530c5afd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:39.497280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 130/273] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:39 2022] GET /identity/v3/role_assignments?user.id=c497a16afc3a433088dca5c4ab1dd700&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=af99020fdd8b4a4e93e3b913d49e9cf8 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:39.552093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809cf3-5366-402c-9ffa-d92773dde23f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.552648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809cf3-5366-402c-9ffa-d92773dde23f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.553079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0809cf3-5366-402c-9ffa-d92773dde23f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.554664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 131/274] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:39.563629 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61f70b-f302-449c-bd16-323dc382d8a3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.564146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61f70b-f302-449c-bd16-323dc382d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.564605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e61f70b-f302-449c-bd16-323dc382d8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.599375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6e61f70b-f302-449c-bd16-323dc382d8a3 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:39.603311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6e61f70b-f302-449c-bd16-323dc382d8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:39.622632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269ae24-8f5b-43f8-a9f9-4493355f0112 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:39.663429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c1cb-6575-444f-849d-6d9ae7b7287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:39.664623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c1cb-6575-444f-849d-6d9ae7b7287f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.665139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c1cb-6575-444f-849d-6d9ae7b7287f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.665592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c1cb-6575-444f-849d-6d9ae7b7287f None admin] PATH_INFO: `/v3/users/ea2ff9096881491680d0807241c2d6d8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.680863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c1cb-6575-444f-849d-6d9ae7b7287f None admin] RBAC: Authorizing `identity:get_user(user_id=ea2ff9096881491680d0807241c2d6d8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:39.682658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c1cb-6575-444f-849d-6d9ae7b7287f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:39.684949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 144/275] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:39 2022] GET /identity/v3/users/ea2ff9096881491680d0807241c2d6d8 => generated 293 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:39.686510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e2dc1-2215-4e40-9c57-e367748027e2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.686950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e2dc1-2215-4e40-9c57-e367748027e2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.687893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e2dc1-2215-4e40-9c57-e367748027e2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.689708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 145/276] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:39.692014 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e2dc1-2215-4e40-9c57-e367748027e2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:39.709263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 132/277] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:39.710791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141260ab-dba0-4c44-b7c9-a0e42e9f611f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.711187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141260ab-dba0-4c44-b7c9-a0e42e9f611f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.711577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141260ab-dba0-4c44-b7c9-a0e42e9f611f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.733156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-141260ab-dba0-4c44-b7c9-a0e42e9f611f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:39.734540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-141260ab-dba0-4c44-b7c9-a0e42e9f611f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:39.770372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:39.777467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:39.812765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e2dc1-2215-4e40-9c57-e367748027e2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:39.818047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 133/278] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:39.819214 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141260ab-dba0-4c44-b7c9-a0e42e9f611f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:39.851406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e15e2-49e6-4c84-97f9-59256bc4be9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:39.852655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e15e2-49e6-4c84-97f9-59256bc4be9e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.853084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e15e2-49e6-4c84-97f9-59256bc4be9e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.853506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e15e2-49e6-4c84-97f9-59256bc4be9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.854525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e15e2-49e6-4c84-97f9-59256bc4be9e None admin] RBAC: Adding query filter params (role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, user.id=ea2ff9096881491680d0807241c2d6d8, scope.system=all) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:39.855012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e15e2-49e6-4c84-97f9-59256bc4be9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:39.857260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e15e2-49e6-4c84-97f9-59256bc4be9e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:39.869873 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 146/279] 10.222.0.41 () {56 vars in 1308 bytes} [Thu May 26 12:23:39 2022] GET /identity/v3/role_assignments?user.id=ea2ff9096881491680d0807241c2d6d8&scope.system=all&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:39.870991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e15e2-49e6-4c84-97f9-59256bc4be9e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:39.945784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141260ab-dba0-4c44-b7c9-a0e42e9f611f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:39.985764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e15e2-49e6-4c84-97f9-59256bc4be9e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:39.985957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dbf83-2edd-4626-8b57-12a6e613d249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:39.986587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dbf83-2edd-4626-8b57-12a6e613d249 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:39.986871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dbf83-2edd-4626-8b57-12a6e613d249 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:39.987145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dbf83-2edd-4626-8b57-12a6e613d249 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:39.988385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dbf83-2edd-4626-8b57-12a6e613d249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:39.990653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dbf83-2edd-4626-8b57-12a6e613d249 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:39.996807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 134/280] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:39.999100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dbf83-2edd-4626-8b57-12a6e613d249 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:40.036184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf348f2-07d6-4820-8aef-b0fe6635ab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:40.037331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf348f2-07d6-4820-8aef-b0fe6635ab6c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.037614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf348f2-07d6-4820-8aef-b0fe6635ab6c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.037938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf348f2-07d6-4820-8aef-b0fe6635ab6c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.040924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:40.043176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:40.059514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf348f2-07d6-4820-8aef-b0fe6635ab6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8cf348f2-07d6-4820-8aef-b0fe6635ab6c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:40.067090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:40.067980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:40.069186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 147/281] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:40.074988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf348f2-07d6-4820-8aef-b0fe6635ab6c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:40.149689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dbf83-2edd-4626-8b57-12a6e613d249 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:40.186078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf348f2-07d6-4820-8aef-b0fe6635ab6c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:40.194707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3596f-01cd-4619-aacc-fd1ef023cf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:40.195383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3596f-01cd-4619-aacc-fd1ef023cf4e None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.196118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3596f-01cd-4619-aacc-fd1ef023cf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.196393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3596f-01cd-4619-aacc-fd1ef023cf4e None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.197505 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3596f-01cd-4619-aacc-fd1ef023cf4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:40.199241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3596f-01cd-4619-aacc-fd1ef023cf4e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:40.223817 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b72c9-449a-4fc3-969b-1147eafde659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:40.224654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b72c9-449a-4fc3-969b-1147eafde659 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.224864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b72c9-449a-4fc3-969b-1147eafde659 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.225144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680b72c9-449a-4fc3-969b-1147eafde659 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.226080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b72c9-449a-4fc3-969b-1147eafde659 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:40.226430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b72c9-449a-4fc3-969b-1147eafde659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:40.227813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680b72c9-449a-4fc3-969b-1147eafde659 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:40.237340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 148/282] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:40.242778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b72c9-449a-4fc3-969b-1147eafde659 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:40.303266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:40.312293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 135/283] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:23:39 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:23:40.361310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680b72c9-449a-4fc3-969b-1147eafde659 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:40.409565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795002cb-7e2a-4598-ae17-621d84373476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:40.410420 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795002cb-7e2a-4598-ae17-621d84373476 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.410705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795002cb-7e2a-4598-ae17-621d84373476 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.410997 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795002cb-7e2a-4598-ae17-621d84373476 None admin] PATH_INFO: `/v3/users/8b7154a229e84774ad89986848633ead` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.412359 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795002cb-7e2a-4598-ae17-621d84373476 None admin] RBAC: Authorizing `identity:get_user(user_id=8b7154a229e84774ad89986848633ead)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:40.413897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795002cb-7e2a-4598-ae17-621d84373476 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:40.415960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 149/284] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:40 2022] GET /identity/v3/users/8b7154a229e84774ad89986848633ead => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:40.421658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3596f-01cd-4619-aacc-fd1ef023cf4e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:40.526802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:40.541937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3596f-01cd-4619-aacc-fd1ef023cf4e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:40.576065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef7c02-6ed0-4c59-bfb1-13b1481ef48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:40.577220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef7c02-6ed0-4c59-bfb1-13b1481ef48e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.577651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef7c02-6ed0-4c59-bfb1-13b1481ef48e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.578700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef7c02-6ed0-4c59-bfb1-13b1481ef48e None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.580049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef7c02-6ed0-4c59-bfb1-13b1481ef48e None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:40.581749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef7c02-6ed0-4c59-bfb1-13b1481ef48e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:40.583607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 136/285] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:40 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:40.589693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795002cb-7e2a-4598-ae17-621d84373476 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:40.662236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acffad-68a5-4e6a-8e95-9e2fec5688a0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.662236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acffad-68a5-4e6a-8e95-9e2fec5688a0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.662236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acffad-68a5-4e6a-8e95-9e2fec5688a0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.663632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 137/286] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:40.669093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9a04-0e8b-4bc5-aa1e-e60d354e8d04 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.669385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9a04-0e8b-4bc5-aa1e-e60d354e8d04 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.669690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9a04-0e8b-4bc5-aa1e-e60d354e8d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.693151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-87cc9a04-0e8b-4bc5-aa1e-e60d354e8d04 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:40.694491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-87cc9a04-0e8b-4bc5-aa1e-e60d354e8d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:40.715147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795002cb-7e2a-4598-ae17-621d84373476 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:40.746376 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:40.760779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f8792-f541-4f7f-b3fe-4e6a6145f77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:40.761694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f8792-f541-4f7f-b3fe-4e6a6145f77d None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.762014 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f8792-f541-4f7f-b3fe-4e6a6145f77d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.762378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f8792-f541-4f7f-b3fe-4e6a6145f77d None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/users/8b7154a229e84774ad89986848633ead/roles/35bddef47fa34f62be6f49ddad1b12aa` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.764621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f8792-f541-4f7f-b3fe-4e6a6145f77d None admin] RBAC: Authorizing `identity:create_grant(project_id=4a070bf9ade14aafa5a6b04292868a5c, user_id=8b7154a229e84774ad89986848633ead, role_id=35bddef47fa34f62be6f49ddad1b12aa)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:40.766242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f8792-f541-4f7f-b3fe-4e6a6145f77d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:40.780369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 138/287] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:40.803486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc9a04-0e8b-4bc5-aa1e-e60d354e8d04 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:40.854545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 150/288] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:23:40 2022] PUT /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/users/8b7154a229e84774ad89986848633ead/roles/35bddef47fa34f62be6f49ddad1b12aa => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:23:40.900704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:40.916737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc9a04-0e8b-4bc5-aa1e-e60d354e8d04 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:40.960757 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060ae3b-7edf-4eb7-916e-55692c81b078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:40.961579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060ae3b-7edf-4eb7-916e-55692c81b078 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:40.961890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060ae3b-7edf-4eb7-916e-55692c81b078 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:40.962168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060ae3b-7edf-4eb7-916e-55692c81b078 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:40.982776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060ae3b-7edf-4eb7-916e-55692c81b078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5060ae3b-7edf-4eb7-916e-55692c81b078 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:40.991378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:40.992300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:40.993077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 139/289] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:41.001069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f8792-f541-4f7f-b3fe-4e6a6145f77d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.149133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f8792-f541-4f7f-b3fe-4e6a6145f77d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:41.185197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b10d50-6cf1-4262-a248-babe52395720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:41.185823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b10d50-6cf1-4262-a248-babe52395720 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.186111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b10d50-6cf1-4262-a248-babe52395720 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.186389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b10d50-6cf1-4262-a248-babe52395720 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.187141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b10d50-6cf1-4262-a248-babe52395720 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:41.187992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b10d50-6cf1-4262-a248-babe52395720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:41.189466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b10d50-6cf1-4262-a248-babe52395720 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:41.200425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 151/290] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:41.206481 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060ae3b-7edf-4eb7-916e-55692c81b078 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.340442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060ae3b-7edf-4eb7-916e-55692c81b078 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:41.386535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfedf97-452a-4dc3-a450-98849550cd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:41.387459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedf97-452a-4dc3-a450-98849550cd96 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.387748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedf97-452a-4dc3-a450-98849550cd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.388022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfedf97-452a-4dc3-a450-98849550cd96 None admin] PATH_INFO: `/v3/users/e84e4a936b7445e88f8b36d2f41da73e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.389236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfedf97-452a-4dc3-a450-98849550cd96 None admin] RBAC: Authorizing `identity:get_user(user_id=e84e4a936b7445e88f8b36d2f41da73e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:41.390757 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfedf97-452a-4dc3-a450-98849550cd96 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:41.393322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 140/291] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:41 2022] GET /identity/v3/users/e84e4a936b7445e88f8b36d2f41da73e => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:41.398058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b10d50-6cf1-4262-a248-babe52395720 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.481489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:41.551434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b10d50-6cf1-4262-a248-babe52395720 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:41.601155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84e35e-2272-4010-9861-3166098e62eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:41.601155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84e35e-2272-4010-9861-3166098e62eb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.601155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84e35e-2272-4010-9861-3166098e62eb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.601155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84e35e-2272-4010-9861-3166098e62eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:41.677494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84e35e-2272-4010-9861-3166098e62eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:41.679358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84e35e-2272-4010-9861-3166098e62eb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:41.742153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:41.809545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 152/292] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:41.815419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfedf97-452a-4dc3-a450-98849550cd96 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:41.850965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:41.961823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfedf97-452a-4dc3-a450-98849550cd96 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:41.997611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050a9a7-a232-4af0-ba8a-6dd4a922e5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:41.998430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050a9a7-a232-4af0-ba8a-6dd4a922e5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:41.998718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050a9a7-a232-4af0-ba8a-6dd4a922e5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:41.998995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050a9a7-a232-4af0-ba8a-6dd4a922e5f4 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.000244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050a9a7-a232-4af0-ba8a-6dd4a922e5f4 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:42.001718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050a9a7-a232-4af0-ba8a-6dd4a922e5f4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:42.003732 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 141/293] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:41 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:42.009331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84e35e-2272-4010-9861-3166098e62eb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:42.184578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84e35e-2272-4010-9861-3166098e62eb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:42.240047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2bb34-2bfd-4522-a391-7210c25498ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:42.240715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2bb34-2bfd-4522-a391-7210c25498ff None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.241002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2bb34-2bfd-4522-a391-7210c25498ff None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.241289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2bb34-2bfd-4522-a391-7210c25498ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.242155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2bb34-2bfd-4522-a391-7210c25498ff None admin] RBAC: Adding query filter params (role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c, user.id=e84e4a936b7445e88f8b36d2f41da73e) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:42.242471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2bb34-2bfd-4522-a391-7210c25498ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:42.243905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2bb34-2bfd-4522-a391-7210c25498ff None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:42.254638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 153/294] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:42 2022] GET /identity/v3/role_assignments?user.id=e84e4a936b7445e88f8b36d2f41da73e&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:42.652872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadab7b-2164-41da-b7ff-78f77c594c8f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.653575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadab7b-2164-41da-b7ff-78f77c594c8f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.654131 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadab7b-2164-41da-b7ff-78f77c594c8f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.656706 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 142/295] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:42.661945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e5eb-a34a-4c4e-a96d-15b1352d5d72 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:42.662509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e5eb-a34a-4c4e-a96d-15b1352d5d72 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:42.662983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4e5eb-a34a-4c4e-a96d-15b1352d5d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:42.787117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-28a4e5eb-a34a-4c4e-a96d-15b1352d5d72 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:42.788661 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-28a4e5eb-a34a-4c4e-a96d-15b1352d5d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:42.791957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:42.861831 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 154/296] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:42.884254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadab7b-2164-41da-b7ff-78f77c594c8f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:42.970300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:42.989217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadab7b-2164-41da-b7ff-78f77c594c8f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.026690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd44cfd-41f0-4f4f-97c6-90566068431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.027492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44cfd-41f0-4f4f-97c6-90566068431b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.027785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44cfd-41f0-4f4f-97c6-90566068431b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.028065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44cfd-41f0-4f4f-97c6-90566068431b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.038918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd44cfd-41f0-4f4f-97c6-90566068431b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-bdd44cfd-41f0-4f4f-97c6-90566068431b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:43.047349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:43.048192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:43.048946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 143/297] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:43.055482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4e5eb-a34a-4c4e-a96d-15b1352d5d72 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.070519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504d592-e4ff-4f8e-82fb-eb79b3f3d0b2 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.070833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504d592-e4ff-4f8e-82fb-eb79b3f3d0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.071097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504d592-e4ff-4f8e-82fb-eb79b3f3d0b2 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.072860 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 144/298] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:43.078699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0d29f-ac05-4f75-a917-f728b55f8b39 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.078699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0d29f-ac05-4f75-a917-f728b55f8b39 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.078699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0d29f-ac05-4f75-a917-f728b55f8b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.096703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-dbd0d29f-ac05-4f75-a917-f728b55f8b39 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:43.097943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dbd0d29f-ac05-4f75-a917-f728b55f8b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:43.170994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4e5eb-a34a-4c4e-a96d-15b1352d5d72 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.177479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 145/299] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:43.202166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0d29f-ac05-4f75-a917-f728b55f8b39 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.210402 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140940ea-587a-48f4-a732-0d1d55880915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.211114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140940ea-587a-48f4-a732-0d1d55880915 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.211400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140940ea-587a-48f4-a732-0d1d55880915 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.211665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140940ea-587a-48f4-a732-0d1d55880915 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.212571 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140940ea-587a-48f4-a732-0d1d55880915 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:43.213015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140940ea-587a-48f4-a732-0d1d55880915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.214646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140940ea-587a-48f4-a732-0d1d55880915 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.224015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 155/300] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:43.229297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140940ea-587a-48f4-a732-0d1d55880915 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.232556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.280103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.312985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0d29f-ac05-4f75-a917-f728b55f8b39 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.342004 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140940ea-587a-48f4-a732-0d1d55880915 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.352976 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc376d2f-36f5-44de-baa6-eb4c297cf192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.354272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376d2f-36f5-44de-baa6-eb4c297cf192 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.354730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376d2f-36f5-44de-baa6-eb4c297cf192 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.355154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc376d2f-36f5-44de-baa6-eb4c297cf192 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.356631 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc376d2f-36f5-44de-baa6-eb4c297cf192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.358366 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc376d2f-36f5-44de-baa6-eb4c297cf192 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.360830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 146/301] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:43.362354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf8622-241a-4d16-ad71-4a3111a756bb None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.362797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf8622-241a-4d16-ad71-4a3111a756bb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.363222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf8622-241a-4d16-ad71-4a3111a756bb None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.365241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 147/302] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:43.366562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf8622-241a-4d16-ad71-4a3111a756bb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.389400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb892d64-b343-43e9-a5da-bf86103b1ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.390347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892d64-b343-43e9-a5da-bf86103b1ede None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.390641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892d64-b343-43e9-a5da-bf86103b1ede None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.390914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb892d64-b343-43e9-a5da-bf86103b1ede None admin] PATH_INFO: `/v3/users/ea2ff9096881491680d0807241c2d6d8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.392117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb892d64-b343-43e9-a5da-bf86103b1ede None admin] RBAC: Authorizing `identity:get_user(user_id=ea2ff9096881491680d0807241c2d6d8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.393558 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb892d64-b343-43e9-a5da-bf86103b1ede None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.395233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 156/303] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/users/ea2ff9096881491680d0807241c2d6d8 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:43.396373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2dae9-edd3-428b-9ac8-26c9038f8652 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.396664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2dae9-edd3-428b-9ac8-26c9038f8652 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.396946 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2dae9-edd3-428b-9ac8-26c9038f8652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.413320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-87f2dae9-edd3-428b-9ac8-26c9038f8652 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:43.414530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-87f2dae9-edd3-428b-9ac8-26c9038f8652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:43.479162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf8622-241a-4d16-ad71-4a3111a756bb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.481075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.487271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 157/304] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:43.488069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2dae9-edd3-428b-9ac8-26c9038f8652 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.526978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc61b2-3b6b-4804-bc92-7e3573795581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.527651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc61b2-3b6b-4804-bc92-7e3573795581 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.527934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc61b2-3b6b-4804-bc92-7e3573795581 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.528209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc61b2-3b6b-4804-bc92-7e3573795581 None admin] PATH_INFO: `/v3/groups` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.528892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc61b2-3b6b-4804-bc92-7e3573795581 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.530359 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc61b2-3b6b-4804-bc92-7e3573795581 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.594155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2dae9-edd3-428b-9ac8-26c9038f8652 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.627195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d542218-94d9-42da-8c0c-284d4b34b9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.628053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d542218-94d9-42da-8c0c-284d4b34b9e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.628337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d542218-94d9-42da-8c0c-284d4b34b9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.628614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d542218-94d9-42da-8c0c-284d4b34b9e1 None admin] PATH_INFO: `/v3/system/users/ea2ff9096881491680d0807241c2d6d8/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.629268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.630133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d542218-94d9-42da-8c0c-284d4b34b9e1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea2ff9096881491680d0807241c2d6d8, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.631589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d542218-94d9-42da-8c0c-284d4b34b9e1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.634432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 148/305] 10.222.0.41 () {60 vars in 1134 bytes} [Thu May 26 12:23:43 2022] POST /identity/v3/groups => generated 229 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:23:43.635338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc61b2-3b6b-4804-bc92-7e3573795581 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.741916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc61b2-3b6b-4804-bc92-7e3573795581 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.776264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e13c9-afce-4fbc-8796-ebd2fbe1a4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.793651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e13c9-afce-4fbc-8796-ebd2fbe1a4ae None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.793651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e13c9-afce-4fbc-8796-ebd2fbe1a4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.793651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e13c9-afce-4fbc-8796-ebd2fbe1a4ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.793651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e13c9-afce-4fbc-8796-ebd2fbe1a4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b92e13c9-afce-4fbc-8796-ebd2fbe1a4ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:43.797804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:43.798704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:43.799572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 149/306] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:43.800686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e82cf-4d4f-407c-8a65-ee8bd36a72ad None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.800686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e82cf-4d4f-407c-8a65-ee8bd36a72ad None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.800904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e82cf-4d4f-407c-8a65-ee8bd36a72ad None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.802351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 150/307] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:43.804726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e82cf-4d4f-407c-8a65-ee8bd36a72ad None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.879739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 158/308] 10.222.0.41 () {58 vars in 1334 bytes} [Thu May 26 12:23:43 2022] PUT /identity/v3/system/users/ea2ff9096881491680d0807241c2d6d8/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:43.881766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e832d0-7e5a-4353-a406-2f265d947cee None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.882081 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e832d0-7e5a-4353-a406-2f265d947cee None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.882409 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e832d0-7e5a-4353-a406-2f265d947cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.906656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-97e832d0-7e5a-4353-a406-2f265d947cee None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:43.908837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-97e832d0-7e5a-4353-a406-2f265d947cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:43.911470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e82cf-4d4f-407c-8a65-ee8bd36a72ad None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:43.921077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:43.953496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac15a5c-6979-44dd-b7ab-6e9fddced560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:43.954221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac15a5c-6979-44dd-b7ab-6e9fddced560 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:43.954514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac15a5c-6979-44dd-b7ab-6e9fddced560 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:43.954798 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac15a5c-6979-44dd-b7ab-6e9fddced560 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:43.955582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac15a5c-6979-44dd-b7ab-6e9fddced560 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:43.955893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac15a5c-6979-44dd-b7ab-6e9fddced560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:43.957863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac15a5c-6979-44dd-b7ab-6e9fddced560 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:43.973782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 151/309] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:43.979157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac15a5c-6979-44dd-b7ab-6e9fddced560 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:43.990756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:44.001920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 159/310] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:44.028817 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e832d0-7e5a-4353-a406-2f265d947cee None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:44.092979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac15a5c-6979-44dd-b7ab-6e9fddced560 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.127507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:44.144038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ebc9b-05d7-4304-b0d6-ec593eeb9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.145887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ebc9b-05d7-4304-b0d6-ec593eeb9d1b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.146352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ebc9b-05d7-4304-b0d6-ec593eeb9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.146779 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ebc9b-05d7-4304-b0d6-ec593eeb9d1b None admin] PATH_INFO: `/v3/users/3174cc6b14a34b8b9b62a3821d5f89a8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.147655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e832d0-7e5a-4353-a406-2f265d947cee None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.165074 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ebc9b-05d7-4304-b0d6-ec593eeb9d1b None admin] RBAC: Authorizing `identity:get_user(user_id=3174cc6b14a34b8b9b62a3821d5f89a8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:44.166907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ebc9b-05d7-4304-b0d6-ec593eeb9d1b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:44.169776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 152/311] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:43 2022] GET /identity/v3/users/3174cc6b14a34b8b9b62a3821d5f89a8 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:44.178654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ebc9b-05d7-4304-b0d6-ec593eeb9d1b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:44.192175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c14e83-b5d8-4e48-ac8d-429d0034804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.193064 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14e83-b5d8-4e48-ac8d-429d0034804d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.193450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14e83-b5d8-4e48-ac8d-429d0034804d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.193839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14e83-b5d8-4e48-ac8d-429d0034804d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.204812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c14e83-b5d8-4e48-ac8d-429d0034804d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-67c14e83-b5d8-4e48-ac8d-429d0034804d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:44.212614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:44.213479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:44.214271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 160/312] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:44.221219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c14e83-b5d8-4e48-ac8d-429d0034804d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:44.290765 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ebc9b-05d7-4304-b0d6-ec593eeb9d1b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.302906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:44.330319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fd49d-472d-412b-a5d1-b048f54c5088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.331081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd49d-472d-412b-a5d1-b048f54c5088 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.331461 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd49d-472d-412b-a5d1-b048f54c5088 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.331817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fd49d-472d-412b-a5d1-b048f54c5088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.332729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fd49d-472d-412b-a5d1-b048f54c5088 None admin] RBAC: Adding query filter params (role.id=35bddef47fa34f62be6f49ddad1b12aa, user.id=3174cc6b14a34b8b9b62a3821d5f89a8, scope.system=all) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:44.333120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fd49d-472d-412b-a5d1-b048f54c5088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:44.334683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fd49d-472d-412b-a5d1-b048f54c5088 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:44.341378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 153/313] 10.222.0.41 () {56 vars in 1308 bytes} [Thu May 26 12:23:44 2022] GET /identity/v3/role_assignments?user.id=3174cc6b14a34b8b9b62a3821d5f89a8&scope.system=all&role.id=35bddef47fa34f62be6f49ddad1b12aa => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:44.360732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c14e83-b5d8-4e48-ac8d-429d0034804d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.400636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ad63a-4347-4edd-906a-e84a0d21ccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.401326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ad63a-4347-4edd-906a-e84a0d21ccc5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.401612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ad63a-4347-4edd-906a-e84a0d21ccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.401927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ad63a-4347-4edd-906a-e84a0d21ccc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.402705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ad63a-4347-4edd-906a-e84a0d21ccc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:44.403019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ad63a-4347-4edd-906a-e84a0d21ccc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:44.404465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ad63a-4347-4edd-906a-e84a0d21ccc5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:44.415433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 161/314] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:44.421053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fd49d-472d-412b-a5d1-b048f54c5088 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:44.479617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:44.541158 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fd49d-472d-412b-a5d1-b048f54c5088 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:44.576496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b33552-2106-45a8-ab65-9ef687883d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:44.577372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b33552-2106-45a8-ab65-9ef687883d76 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:44.577675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b33552-2106-45a8-ab65-9ef687883d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:44.578542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b33552-2106-45a8-ab65-9ef687883d76 None admin] PATH_INFO: `/v3/users/8b7154a229e84774ad89986848633ead` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:44.579808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b33552-2106-45a8-ab65-9ef687883d76 None admin] RBAC: Authorizing `identity:get_user(user_id=8b7154a229e84774ad89986848633ead)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:44.581269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b33552-2106-45a8-ab65-9ef687883d76 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:44.583283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 154/315] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:44 2022] GET /identity/v3/users/8b7154a229e84774ad89986848633ead => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:44.590762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ad63a-4347-4edd-906a-e84a0d21ccc5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:45.119793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ad63a-4347-4edd-906a-e84a0d21ccc5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:45.137002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:45.154811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd69496-011b-4306-9b7a-347021d761d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:45.155459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd69496-011b-4306-9b7a-347021d761d7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.155844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd69496-011b-4306-9b7a-347021d761d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.156132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd69496-011b-4306-9b7a-347021d761d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.224317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd69496-011b-4306-9b7a-347021d761d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:45.225801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd69496-011b-4306-9b7a-347021d761d7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:45.325207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 162/316] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:45.330812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b33552-2106-45a8-ab65-9ef687883d76 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:45.432346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b33552-2106-45a8-ab65-9ef687883d76 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:45.446266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:45.467737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13927951-0ddb-4a8c-a633-21bf1512d935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:45.469194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927951-0ddb-4a8c-a633-21bf1512d935 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.469479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927951-0ddb-4a8c-a633-21bf1512d935 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.469799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13927951-0ddb-4a8c-a633-21bf1512d935 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.471078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13927951-0ddb-4a8c-a633-21bf1512d935 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:45.472598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13927951-0ddb-4a8c-a633-21bf1512d935 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:45.474851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 155/317] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:45 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:45.481139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd69496-011b-4306-9b7a-347021d761d7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:45.499088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:45.586553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd69496-011b-4306-9b7a-347021d761d7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:45.623503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8fc81a-e5bb-45eb-9e1e-629b77029e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:45.626832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fc81a-e5bb-45eb-9e1e-629b77029e24 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.626832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fc81a-e5bb-45eb-9e1e-629b77029e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.626832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fc81a-e5bb-45eb-9e1e-629b77029e24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.626832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fc81a-e5bb-45eb-9e1e-629b77029e24 None admin] RBAC: Adding query filter params (role.id=35bddef47fa34f62be6f49ddad1b12aa, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c, user.id=8b7154a229e84774ad89986848633ead) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:45.626832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fc81a-e5bb-45eb-9e1e-629b77029e24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:45.628821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8fc81a-e5bb-45eb-9e1e-629b77029e24 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:45.635672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 163/318] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:23:45 2022] GET /identity/v3/role_assignments?user.id=8b7154a229e84774ad89986848633ead&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=35bddef47fa34f62be6f49ddad1b12aa => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:46.014587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fe7b9-3639-4d6d-8bd0-2ad645aa1c9c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.014991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fe7b9-3639-4d6d-8bd0-2ad645aa1c9c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.015182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fe7b9-3639-4d6d-8bd0-2ad645aa1c9c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.016709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 156/319] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:46.021868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9712-0a15-454f-af34-63d6d4fe64c3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.022167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9712-0a15-454f-af34-63d6d4fe64c3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.022453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b9712-0a15-454f-af34-63d6d4fe64c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.039324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-685b9712-0a15-454f-af34-63d6d4fe64c3 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:46.040525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-685b9712-0a15-454f-af34-63d6d4fe64c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:46.114110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 164/320] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:46.136039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fe7b9-3639-4d6d-8bd0-2ad645aa1c9c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.158162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4502-dd54-4a44-b833-7f7d32b936fc None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.158657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4502-dd54-4a44-b833-7f7d32b936fc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.158770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c4502-dd54-4a44-b833-7f7d32b936fc None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.160720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 165/321] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:46.165761 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446f5f-de3b-477b-89c5-1aefee33398d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.166052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446f5f-de3b-477b-89c5-1aefee33398d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.166331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56446f5f-de3b-477b-89c5-1aefee33398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.182814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-56446f5f-de3b-477b-89c5-1aefee33398d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:46.183982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-56446f5f-de3b-477b-89c5-1aefee33398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:46.186934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:46.245493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fe7b9-3639-4d6d-8bd0-2ad645aa1c9c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:46.259467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 166/322] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:46.280808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b46b06-d165-4fb3-a10b-265c7b9315c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:46.282292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b46b06-d165-4fb3-a10b-265c7b9315c1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.282407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b46b06-d165-4fb3-a10b-265c7b9315c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.282653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b46b06-d165-4fb3-a10b-265c7b9315c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.283248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446f5f-de3b-477b-89c5-1aefee33398d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.283800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b46b06-d165-4fb3-a10b-265c7b9315c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:46.285266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b46b06-d165-4fb3-a10b-265c7b9315c1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:46.287024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 157/323] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:46.292382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b46b06-d165-4fb3-a10b-265c7b9315c1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.345617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:46.394021 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56446f5f-de3b-477b-89c5-1aefee33398d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:46.398543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b46b06-d165-4fb3-a10b-265c7b9315c1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:46.435426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb38c38-5028-4ad7-b221-aefdc75e59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:46.436244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38c38-5028-4ad7-b221-aefdc75e59c8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.436532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38c38-5028-4ad7-b221-aefdc75e59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.436813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb38c38-5028-4ad7-b221-aefdc75e59c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.442403 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c38a9-05cd-4491-96bf-9389e21c0491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:46.443566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c38a9-05cd-4491-96bf-9389e21c0491 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.444073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c38a9-05cd-4491-96bf-9389e21c0491 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.444548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c38a9-05cd-4491-96bf-9389e21c0491 None admin] PATH_INFO: `/v3/groups` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.445421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c38a9-05cd-4491-96bf-9389e21c0491 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:46.447216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c38a9-05cd-4491-96bf-9389e21c0491 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:46.447397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:46.451073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb38c38-5028-4ad7-b221-aefdc75e59c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4cb38c38-5028-4ad7-b221-aefdc75e59c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:46.459641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:46.462482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:46.463473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 167/324] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:46.466447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb38c38-5028-4ad7-b221-aefdc75e59c8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.548892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 158/325] 10.222.0.41 () {60 vars in 1134 bytes} [Thu May 26 12:23:46 2022] POST /identity/v3/groups => generated 226 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:23:46.575478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb38c38-5028-4ad7-b221-aefdc75e59c8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:46.608470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c682a-025c-4bb3-81ed-44c2e5cb1485 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.608840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c682a-025c-4bb3-81ed-44c2e5cb1485 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.609088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c682a-025c-4bb3-81ed-44c2e5cb1485 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.610557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 159/326] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:46.614318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff244624-b53f-4711-8a8f-4e69ec8412f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:46.615233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff244624-b53f-4711-8a8f-4e69ec8412f8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.615705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff244624-b53f-4711-8a8f-4e69ec8412f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.616141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff244624-b53f-4711-8a8f-4e69ec8412f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.616300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b505-8f0f-40b1-82d5-3cf838dba757 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.616596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b505-8f0f-40b1-82d5-3cf838dba757 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.616878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4b505-8f0f-40b1-82d5-3cf838dba757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.617062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff244624-b53f-4711-8a8f-4e69ec8412f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:46.617374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff244624-b53f-4711-8a8f-4e69ec8412f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:46.618845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff244624-b53f-4711-8a8f-4e69ec8412f8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:46.633723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 168/327] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:46.634918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff244624-b53f-4711-8a8f-4e69ec8412f8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.635334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-18f4b505-8f0f-40b1-82d5-3cf838dba757 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:46.636513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-18f4b505-8f0f-40b1-82d5-3cf838dba757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:46.710698 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:46.716434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 160/328] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:46.739104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4b505-8f0f-40b1-82d5-3cf838dba757 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.751656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff244624-b53f-4711-8a8f-4e69ec8412f8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:46.784448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:46.793215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ae122-e148-41c9-b49b-30c289a1116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:46.802000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae122-e148-41c9-b49b-30c289a1116c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.802000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae122-e148-41c9-b49b-30c289a1116c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.802000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae122-e148-41c9-b49b-30c289a1116c None admin] PATH_INFO: `/v3/users/ea2ff9096881491680d0807241c2d6d8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.802000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ae122-e148-41c9-b49b-30c289a1116c None admin] RBAC: Authorizing `identity:get_user(user_id=ea2ff9096881491680d0807241c2d6d8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:46.802000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ae122-e148-41c9-b49b-30c289a1116c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:46.802000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 169/329] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/users/ea2ff9096881491680d0807241c2d6d8 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:46.805275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ae122-e148-41c9-b49b-30c289a1116c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.870506 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4b505-8f0f-40b1-82d5-3cf838dba757 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:46.914177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecc8df-7268-4c9d-858b-ad589cc9a89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:46.914988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecc8df-7268-4c9d-858b-ad589cc9a89a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.915274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecc8df-7268-4c9d-858b-ad589cc9a89a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.915548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ecc8df-7268-4c9d-858b-ad589cc9a89a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.930365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ecc8df-7268-4c9d-858b-ad589cc9a89a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:46.931581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ae122-e148-41c9-b49b-30c289a1116c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-44ecc8df-7268-4c9d-858b-ad589cc9a89a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:46.939761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:46.940649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:46.941432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:46.947608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 161/330] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:46.948692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecc8df-7268-4c9d-858b-ad589cc9a89a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:46.965121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:46.971910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08452161-197e-4acb-97aa-9207d5608944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:46.972621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08452161-197e-4acb-97aa-9207d5608944 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:46.973018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08452161-197e-4acb-97aa-9207d5608944 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:46.973307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08452161-197e-4acb-97aa-9207d5608944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:46.974513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08452161-197e-4acb-97aa-9207d5608944 None admin] RBAC: Adding query filter params (role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, user.id=ea2ff9096881491680d0807241c2d6d8, scope.system=all) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:46.974513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08452161-197e-4acb-97aa-9207d5608944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:46.975912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08452161-197e-4acb-97aa-9207d5608944 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:46.990026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 170/331] 10.222.0.41 () {56 vars in 1308 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/role_assignments?user.id=ea2ff9096881491680d0807241c2d6d8&scope.system=all&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:47.070750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:47.075116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ecc8df-7268-4c9d-858b-ad589cc9a89a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:47.115689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e342d-b615-4410-8416-cda31ced6eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:47.116374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e342d-b615-4410-8416-cda31ced6eba None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.116660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e342d-b615-4410-8416-cda31ced6eba None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.116934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e342d-b615-4410-8416-cda31ced6eba None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:47.117724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e342d-b615-4410-8416-cda31ced6eba None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:47.118040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e342d-b615-4410-8416-cda31ced6eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:47.119468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e342d-b615-4410-8416-cda31ced6eba None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:47.129519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 162/332] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:47.135104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08452161-197e-4acb-97aa-9207d5608944 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:47.266914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08452161-197e-4acb-97aa-9207d5608944 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:47.311137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1888a5be-7147-48c3-bcdb-af6929996023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:47.312775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888a5be-7147-48c3-bcdb-af6929996023 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.312881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888a5be-7147-48c3-bcdb-af6929996023 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.313129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1888a5be-7147-48c3-bcdb-af6929996023 None admin] PATH_INFO: `/v3/users/3174cc6b14a34b8b9b62a3821d5f89a8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:47.314356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888a5be-7147-48c3-bcdb-af6929996023 None admin] RBAC: Authorizing `identity:get_user(user_id=3174cc6b14a34b8b9b62a3821d5f89a8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:47.315802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1888a5be-7147-48c3-bcdb-af6929996023 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:47.317694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 171/333] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:47 2022] GET /identity/v3/users/3174cc6b14a34b8b9b62a3821d5f89a8 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:47.323480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e342d-b615-4410-8416-cda31ced6eba None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:47.430898 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e342d-b615-4410-8416-cda31ced6eba None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:47.467185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127088-db7f-481e-bb16-1007e89e59ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:47.468114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127088-db7f-481e-bb16-1007e89e59ef None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:47.468432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127088-db7f-481e-bb16-1007e89e59ef None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:47.468714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127088-db7f-481e-bb16-1007e89e59ef None admin] PATH_INFO: `/v3/system/users/3174cc6b14a34b8b9b62a3821d5f89a8/roles/35bddef47fa34f62be6f49ddad1b12aa` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:47.470285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a127088-db7f-481e-bb16-1007e89e59ef None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3174cc6b14a34b8b9b62a3821d5f89a8, role_id=35bddef47fa34f62be6f49ddad1b12aa)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:47.471736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a127088-db7f-481e-bb16-1007e89e59ef None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:47.531983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 163/334] 10.222.0.41 () {58 vars in 1334 bytes} [Thu May 26 12:23:47 2022] PUT /identity/v3/system/users/3174cc6b14a34b8b9b62a3821d5f89a8/roles/35bddef47fa34f62be6f49ddad1b12aa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:49.082032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203f6a-ab94-4697-b5aa-c77d19da728c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.082435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203f6a-ab94-4697-b5aa-c77d19da728c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.082630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203f6a-ab94-4697-b5aa-c77d19da728c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.085082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 172/335] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:49.089302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4bec6-599c-45ec-b77a-3a0cbe713126 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.089738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4bec6-599c-45ec-b77a-3a0cbe713126 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.089924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4bec6-599c-45ec-b77a-3a0cbe713126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.115028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1ff4bec6-599c-45ec-b77a-3a0cbe713126 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:49.116232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1ff4bec6-599c-45ec-b77a-3a0cbe713126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:49.140565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.195699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 164/336] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:49.234172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd203f6a-ab94-4697-b5aa-c77d19da728c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.299506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.363305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd203f6a-ab94-4697-b5aa-c77d19da728c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.410108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283a75d-abaa-41a3-aeb6-07dc83bd1295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.410939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283a75d-abaa-41a3-aeb6-07dc83bd1295 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.411236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283a75d-abaa-41a3-aeb6-07dc83bd1295 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.411522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283a75d-abaa-41a3-aeb6-07dc83bd1295 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.426532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d283a75d-abaa-41a3-aeb6-07dc83bd1295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d283a75d-abaa-41a3-aeb6-07dc83bd1295 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:49.434084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:49.434912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:49.435681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:49.436712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 173/337] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:49.441579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4bec6-599c-45ec-b77a-3a0cbe713126 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.571487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4bec6-599c-45ec-b77a-3a0cbe713126 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.613597 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680480fc-0df8-417d-af42-75ccaea1852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.614220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680480fc-0df8-417d-af42-75ccaea1852f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.614507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680480fc-0df8-417d-af42-75ccaea1852f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.614785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680480fc-0df8-417d-af42-75ccaea1852f None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.615575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680480fc-0df8-417d-af42-75ccaea1852f None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:49.615882 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680480fc-0df8-417d-af42-75ccaea1852f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:49.617268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680480fc-0df8-417d-af42-75ccaea1852f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:49.630086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 165/338] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:49.635759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283a75d-abaa-41a3-aeb6-07dc83bd1295 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:49.869770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361df4d9-94c4-405a-8202-6ce6ee2c103e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.870110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361df4d9-94c4-405a-8202-6ce6ee2c103e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.870282 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361df4d9-94c4-405a-8202-6ce6ee2c103e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.872128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 166/339] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:49.877488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ec061-0f54-42a4-be03-db6b3d951f5c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.877802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ec061-0f54-42a4-be03-db6b3d951f5c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.878092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ec061-0f54-42a4-be03-db6b3d951f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:49.899476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283a75d-abaa-41a3-aeb6-07dc83bd1295 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:49.914693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-922ec061-0f54-42a4-be03-db6b3d951f5c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:49.915896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-922ec061-0f54-42a4-be03-db6b3d951f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:49.922012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.936233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:49.947350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276718-1c94-4480-b03b-4744b13c55c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:49.948019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276718-1c94-4480-b03b-4744b13c55c2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:49.948306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276718-1c94-4480-b03b-4744b13c55c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:49.948581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3276718-1c94-4480-b03b-4744b13c55c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.024686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 167/340] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:50.060078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ec061-0f54-42a4-be03-db6b3d951f5c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:50.089332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276718-1c94-4480-b03b-4744b13c55c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.091494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3276718-1c94-4480-b03b-4744b13c55c2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.199483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ec061-0f54-42a4-be03-db6b3d951f5c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:50.245531 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 174/341] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:50.248557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0acee0-a261-465e-830b-4550e177eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:50.248557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0acee0-a261-465e-830b-4550e177eddd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:50.248557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0acee0-a261-465e-830b-4550e177eddd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:50.248557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0acee0-a261-465e-830b-4550e177eddd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.251559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276718-1c94-4480-b03b-4744b13c55c2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:50.260351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0acee0-a261-465e-830b-4550e177eddd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7d0acee0-a261-465e-830b-4550e177eddd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:50.269252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:50.270286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:50.271212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:50.273413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 168/342] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:50.277735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:50.279413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0acee0-a261-465e-830b-4550e177eddd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:50.295195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:50.393924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3276718-1c94-4480-b03b-4744b13c55c2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:50.404909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0acee0-a261-465e-830b-4550e177eddd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:50.444028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596f750-4f46-4330-9534-06dc3cf33a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:50.444272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad88f-e4db-479f-ab98-fbae50adbde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:50.444978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad88f-e4db-479f-ab98-fbae50adbde5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:50.445363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad88f-e4db-479f-ab98-fbae50adbde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:50.445600 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596f750-4f46-4330-9534-06dc3cf33a30 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:50.445835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbad88f-e4db-479f-ab98-fbae50adbde5 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.446202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596f750-4f46-4330-9534-06dc3cf33a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:50.446625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596f750-4f46-4330-9534-06dc3cf33a30 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.446863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbad88f-e4db-479f-ab98-fbae50adbde5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:50.447265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbad88f-e4db-479f-ab98-fbae50adbde5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.448322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596f750-4f46-4330-9534-06dc3cf33a30 None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.448852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbad88f-e4db-479f-ab98-fbae50adbde5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.450217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596f750-4f46-4330-9534-06dc3cf33a30 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.452638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 175/343] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:50 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:50.458917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596f750-4f46-4330-9534-06dc3cf33a30 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:50.463603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 169/344] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:50.468991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad88f-e4db-479f-ab98-fbae50adbde5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:50.549141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:50.556215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:50.576117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596f750-4f46-4330-9534-06dc3cf33a30 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:50.585133 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbad88f-e4db-479f-ab98-fbae50adbde5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:50.616723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd31426-eafa-47e6-b3d5-885c3350d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:50.618127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd31426-eafa-47e6-b3d5-885c3350d946 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:50.618664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd31426-eafa-47e6-b3d5-885c3350d946 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:50.619220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd31426-eafa-47e6-b3d5-885c3350d946 None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.622691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e7819-2c04-4b0b-b967-921aa712d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:50.623344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e7819-2c04-4b0b-b967-921aa712d047 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:50.623624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e7819-2c04-4b0b-b967-921aa712d047 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:50.623914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e7819-2c04-4b0b-b967-921aa712d047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.629734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd31426-eafa-47e6-b3d5-885c3350d946 None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.631619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd31426-eafa-47e6-b3d5-885c3350d946 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.634046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 176/345] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:50 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:50.641549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd31426-eafa-47e6-b3d5-885c3350d946 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:50.696735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e7819-2c04-4b0b-b967-921aa712d047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.698260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e7819-2c04-4b0b-b967-921aa712d047 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.781486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:50.797421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd31426-eafa-47e6-b3d5-885c3350d946 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:50.810085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 170/346] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:50.816473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e7819-2c04-4b0b-b967-921aa712d047 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:50.851421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67972998-85ef-4dff-b4fc-d5af5f4a7a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:50.852102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67972998-85ef-4dff-b4fc-d5af5f4a7a06 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:50.852388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67972998-85ef-4dff-b4fc-d5af5f4a7a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:50.852670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67972998-85ef-4dff-b4fc-d5af5f4a7a06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.853512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67972998-85ef-4dff-b4fc-d5af5f4a7a06 None admin] RBAC: Adding query filter params (group.id=8d831d22914f414cabd18e7e97171705, role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:50.853859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67972998-85ef-4dff-b4fc-d5af5f4a7a06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.855384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67972998-85ef-4dff-b4fc-d5af5f4a7a06 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.868852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 177/347] 10.222.0.41 () {56 vars in 1376 bytes} [Thu May 26 12:23:50 2022] GET /identity/v3/role_assignments?group.id=8d831d22914f414cabd18e7e97171705&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 260 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:50.932953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e7819-2c04-4b0b-b967-921aa712d047 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:50.970693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c43111-9747-4d64-92a3-22c4a538a933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:50.971805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c43111-9747-4d64-92a3-22c4a538a933 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:50.972227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c43111-9747-4d64-92a3-22c4a538a933 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:50.972669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c43111-9747-4d64-92a3-22c4a538a933 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:50.974048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c43111-9747-4d64-92a3-22c4a538a933 None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:50.975639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c43111-9747-4d64-92a3-22c4a538a933 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:50.977770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 171/348] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:50 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:50.983338 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67972998-85ef-4dff-b4fc-d5af5f4a7a06 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.017054 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.147562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67972998-85ef-4dff-b4fc-d5af5f4a7a06 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.189885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09d11ce-6244-4dd2-819a-068d9b04d62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.190749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d11ce-6244-4dd2-819a-068d9b04d62c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.191037 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d11ce-6244-4dd2-819a-068d9b04d62c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.191314 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09d11ce-6244-4dd2-819a-068d9b04d62c None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.192508 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d11ce-6244-4dd2-819a-068d9b04d62c None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:51.194018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09d11ce-6244-4dd2-819a-068d9b04d62c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:51.195811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 178/349] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:50 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:51.201646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c43111-9747-4d64-92a3-22c4a538a933 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.249442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.291486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd05cb2-de38-4e8f-8f8c-67bd9b49ce65 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.291798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd05cb2-de38-4e8f-8f8c-67bd9b49ce65 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.292036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd05cb2-de38-4e8f-8f8c-67bd9b49ce65 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.293393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 179/350] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:51.301431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419a16-da6b-44bd-be28-3202b8bd0aa1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.301740 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419a16-da6b-44bd-be28-3202b8bd0aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.302023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419a16-da6b-44bd-be28-3202b8bd0aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.326964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ce419a16-da6b-44bd-be28-3202b8bd0aa1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:51.329048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ce419a16-da6b-44bd-be28-3202b8bd0aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:51.344287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c43111-9747-4d64-92a3-22c4a538a933 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.383750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e4fd7-30c3-4688-a19f-780d1bde9b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.384823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e4fd7-30c3-4688-a19f-780d1bde9b51 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.385324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e4fd7-30c3-4688-a19f-780d1bde9b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.385829 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e4fd7-30c3-4688-a19f-780d1bde9b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.386928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e4fd7-30c3-4688-a19f-780d1bde9b51 None admin] RBAC: Adding query filter params (group.id=8d831d22914f414cabd18e7e97171705, role.id=af99020fdd8b4a4e93e3b913d49e9cf8, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:51.387460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e4fd7-30c3-4688-a19f-780d1bde9b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:51.390686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e4fd7-30c3-4688-a19f-780d1bde9b51 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:51.397489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 172/351] 10.222.0.41 () {56 vars in 1376 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/role_assignments?group.id=8d831d22914f414cabd18e7e97171705&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=af99020fdd8b4a4e93e3b913d49e9cf8 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:51.399078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a177-78c1-4206-beb9-27b0c9d8f4b2 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.399584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a177-78c1-4206-beb9-27b0c9d8f4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.405717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518a177-78c1-4206-beb9-27b0c9d8f4b2 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.408460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 173/352] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:51.410021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69abd9-6724-46dc-838f-c3a0472e4412 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.410533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69abd9-6724-46dc-838f-c3a0472e4412 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.411034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69abd9-6724-46dc-838f-c3a0472e4412 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.412453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 174/353] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:51.423216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34615e23-d601-4f1a-884f-ea6dcf5a4834 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.423827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34615e23-d601-4f1a-884f-ea6dcf5a4834 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.424325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34615e23-d601-4f1a-884f-ea6dcf5a4834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.429152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 180/354] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:51.430583 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa76f-f25b-462b-bdd7-a5f76d16eb7d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.430905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa76f-f25b-462b-bdd7-a5f76d16eb7d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.431193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0aa76f-f25b-462b-bdd7-a5f76d16eb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.450896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-34615e23-d601-4f1a-884f-ea6dcf5a4834 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:51.453012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-34615e23-d601-4f1a-884f-ea6dcf5a4834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:51.469701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-af0aa76f-f25b-462b-bdd7-a5f76d16eb7d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:51.469701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-af0aa76f-f25b-462b-bdd7-a5f76d16eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:51.471216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.552961 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 175/355] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:51.554182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34615e23-d601-4f1a-884f-ea6dcf5a4834 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.565728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 181/356] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:51.601769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.607568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aa76f-f25b-462b-bdd7-a5f76d16eb7d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.681052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34615e23-d601-4f1a-884f-ea6dcf5a4834 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.732849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8533bd-5665-449c-bc89-4cf6958a321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.733750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8533bd-5665-449c-bc89-4cf6958a321e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.734043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8533bd-5665-449c-bc89-4cf6958a321e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.734321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8533bd-5665-449c-bc89-4cf6958a321e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.745278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8533bd-5665-449c-bc89-4cf6958a321e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ac8533bd-5665-449c-bc89-4cf6958a321e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:51.754002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:51.754943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:51.755752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 176/357] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:51.756944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8533bd-5665-449c-bc89-4cf6958a321e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.781231 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0aa76f-f25b-462b-bdd7-a5f76d16eb7d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.830859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82155f1d-2772-4063-8aa9-6957460580f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.830859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82155f1d-2772-4063-8aa9-6957460580f6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.831141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82155f1d-2772-4063-8aa9-6957460580f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.831377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82155f1d-2772-4063-8aa9-6957460580f6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.844393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.848351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82155f1d-2772-4063-8aa9-6957460580f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-82155f1d-2772-4063-8aa9-6957460580f6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:51.857395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:51.858339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:51.859165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 182/358] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:51.860303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31516af6-7d8e-4c80-8d1a-641a3b58e080 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.860408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31516af6-7d8e-4c80-8d1a-641a3b58e080 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.860636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31516af6-7d8e-4c80-8d1a-641a3b58e080 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.862487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 183/359] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:51.867496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31516af6-7d8e-4c80-8d1a-641a3b58e080 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:51.877027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:51.891285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8533bd-5665-449c-bc89-4cf6958a321e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:51.937845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c013-d922-46f3-97bc-feb0694eb999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:51.939265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c013-d922-46f3-97bc-feb0694eb999 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:51.939955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c013-d922-46f3-97bc-feb0694eb999 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:51.940855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6c013-d922-46f3-97bc-feb0694eb999 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:51.966475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6c013-d922-46f3-97bc-feb0694eb999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-fbc6c013-d922-46f3-97bc-feb0694eb999 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:51.978492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:51.979390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:51.980166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:51.983185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 177/360] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:51.984172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c013-d922-46f3-97bc-feb0694eb999 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.009061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31516af6-7d8e-4c80-8d1a-641a3b58e080 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.054589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc838c7d-4486-4f65-a28c-c29d62f63101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.055635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc838c7d-4486-4f65-a28c-c29d62f63101 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.056439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc838c7d-4486-4f65-a28c-c29d62f63101 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.056897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc838c7d-4486-4f65-a28c-c29d62f63101 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.057972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc838c7d-4486-4f65-a28c-c29d62f63101 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:52.058430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc838c7d-4486-4f65-a28c-c29d62f63101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.060400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc838c7d-4486-4f65-a28c-c29d62f63101 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.072954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 184/361] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:52.078970 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067268-94e7-46c6-8a65-386f5a0be5b5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.079457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067268-94e7-46c6-8a65-386f5a0be5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.079881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e067268-94e7-46c6-8a65-386f5a0be5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.101173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5e067268-94e7-46c6-8a65-386f5a0be5b5 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:52.103017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5e067268-94e7-46c6-8a65-386f5a0be5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:52.130664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6c013-d922-46f3-97bc-feb0694eb999 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.172924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.177263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf1d46-fe8c-4360-a9d2-f8e05cef63c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.178523 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf1d46-fe8c-4360-a9d2-f8e05cef63c8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.178984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf1d46-fe8c-4360-a9d2-f8e05cef63c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.179696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf1d46-fe8c-4360-a9d2-f8e05cef63c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.180738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf1d46-fe8c-4360-a9d2-f8e05cef63c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:52.181210 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf1d46-fe8c-4360-a9d2-f8e05cef63c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.183378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf1d46-fe8c-4360-a9d2-f8e05cef63c8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.186957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 185/362] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:52.189234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e067268-94e7-46c6-8a65-386f5a0be5b5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.193696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 178/363] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:52.195977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf1d46-fe8c-4360-a9d2-f8e05cef63c8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.215929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.317726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e067268-94e7-46c6-8a65-386f5a0be5b5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.318941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf1d46-fe8c-4360-a9d2-f8e05cef63c8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.356175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94da98-9ec2-44a0-b40f-bd4f245709d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.356805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f88683-d40c-45d0-8fde-95b7dfb913c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.357277 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94da98-9ec2-44a0-b40f-bd4f245709d9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.357747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f88683-d40c-45d0-8fde-95b7dfb913c7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.357881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94da98-9ec2-44a0-b40f-bd4f245709d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.358210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f88683-d40c-45d0-8fde-95b7dfb913c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.358445 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94da98-9ec2-44a0-b40f-bd4f245709d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.358668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f88683-d40c-45d0-8fde-95b7dfb913c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.359574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f88683-d40c-45d0-8fde-95b7dfb913c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:52.360105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f88683-d40c-45d0-8fde-95b7dfb913c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.361701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f88683-d40c-45d0-8fde-95b7dfb913c7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.372260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 186/364] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:52.373294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f88683-d40c-45d0-8fde-95b7dfb913c7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.434718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94da98-9ec2-44a0-b40f-bd4f245709d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.436430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d94da98-9ec2-44a0-b40f-bd4f245709d9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.441855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.451970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.501152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f88683-d40c-45d0-8fde-95b7dfb913c7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.545593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f5d0-92dc-40cb-b3d1-cec718466c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.547195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f5d0-92dc-40cb-b3d1-cec718466c89 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.547641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f5d0-92dc-40cb-b3d1-cec718466c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.548061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56f5d0-92dc-40cb-b3d1-cec718466c89 None admin] PATH_INFO: `/v3/users/3174cc6b14a34b8b9b62a3821d5f89a8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.549952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56f5d0-92dc-40cb-b3d1-cec718466c89 None admin] RBAC: Authorizing `identity:get_user(user_id=3174cc6b14a34b8b9b62a3821d5f89a8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.551892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db56f5d0-92dc-40cb-b3d1-cec718466c89 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.554704 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 187/365] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/users/3174cc6b14a34b8b9b62a3821d5f89a8 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:52.556083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f5d0-92dc-40cb-b3d1-cec718466c89 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.566068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 179/366] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:52.567040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94da98-9ec2-44a0-b40f-bd4f245709d9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.688016 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db56f5d0-92dc-40cb-b3d1-cec718466c89 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.696365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94da98-9ec2-44a0-b40f-bd4f245709d9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.715193 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.718903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:52.738513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94c1a-9db2-40f4-9f0b-626989060b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.739527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94c1a-9db2-40f4-9f0b-626989060b16 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.739979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94c1a-9db2-40f4-9f0b-626989060b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.740400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df94c1a-9db2-40f4-9f0b-626989060b16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.741801 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c354a9-bd5d-446a-87f5-c864cf565f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.742572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c354a9-bd5d-446a-87f5-c864cf565f98 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.742949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c354a9-bd5d-446a-87f5-c864cf565f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.743351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c354a9-bd5d-446a-87f5-c864cf565f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.759333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df94c1a-9db2-40f4-9f0b-626989060b16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-5df94c1a-9db2-40f4-9f0b-626989060b16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:52.770745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:52.771708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:52.772515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 188/367] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:52.773184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94c1a-9db2-40f4-9f0b-626989060b16 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.831039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c354a9-bd5d-446a-87f5-c864cf565f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.832534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c354a9-bd5d-446a-87f5-c864cf565f98 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.906849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df94c1a-9db2-40f4-9f0b-626989060b16 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:52.945069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1729936-1356-4851-8d32-03a9a0f3ee7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:52.945648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1729936-1356-4851-8d32-03a9a0f3ee7e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:52.945993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1729936-1356-4851-8d32-03a9a0f3ee7e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:52.946404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1729936-1356-4851-8d32-03a9a0f3ee7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:52.947503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1729936-1356-4851-8d32-03a9a0f3ee7e None admin] RBAC: Adding query filter params (role.id=35bddef47fa34f62be6f49ddad1b12aa, user.id=3174cc6b14a34b8b9b62a3821d5f89a8, scope.system=all) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:52.947662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1729936-1356-4851-8d32-03a9a0f3ee7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:52.949129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1729936-1356-4851-8d32-03a9a0f3ee7e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:52.955133 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 180/368] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:52.956391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c354a9-bd5d-446a-87f5-c864cf565f98 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.962555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 189/369] 10.222.0.41 () {56 vars in 1308 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/role_assignments?user.id=3174cc6b14a34b8b9b62a3821d5f89a8&scope.system=all&role.id=35bddef47fa34f62be6f49ddad1b12aa => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:52.963455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1729936-1356-4851-8d32-03a9a0f3ee7e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:52.975175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.015207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.083856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1729936-1356-4851-8d32-03a9a0f3ee7e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.088740 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c354a9-bd5d-446a-87f5-c864cf565f98 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.122585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5b1b7-15a2-498d-8069-37a35380673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.123329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5b1b7-15a2-498d-8069-37a35380673e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.123555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5b1b7-15a2-498d-8069-37a35380673e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.123839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5b1b7-15a2-498d-8069-37a35380673e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.125450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5b1b7-15a2-498d-8069-37a35380673e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:53.125450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5b1b7-15a2-498d-8069-37a35380673e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.127517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5b1b7-15a2-498d-8069-37a35380673e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.130641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1441df9-753e-4bf6-a9ba-882b5ab853b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.131967 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1441df9-753e-4bf6-a9ba-882b5ab853b0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.132448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1441df9-753e-4bf6-a9ba-882b5ab853b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.132897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1441df9-753e-4bf6-a9ba-882b5ab853b0 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.137127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 190/370] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:53.138116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5b1b7-15a2-498d-8069-37a35380673e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.138567 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1441df9-753e-4bf6-a9ba-882b5ab853b0 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.140245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1441df9-753e-4bf6-a9ba-882b5ab853b0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.142470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 181/371] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:52 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:53.143401 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1441df9-753e-4bf6-a9ba-882b5ab853b0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.247388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.266634 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1441df9-753e-4bf6-a9ba-882b5ab853b0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.308628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5b1b7-15a2-498d-8069-37a35380673e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.310521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.332756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7475c04-fe11-4355-b0d3-f7940a629ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.334324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7475c04-fe11-4355-b0d3-f7940a629ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.336165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7475c04-fe11-4355-b0d3-f7940a629ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.336677 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7475c04-fe11-4355-b0d3-f7940a629ca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.354557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0b2b3-8be3-4223-8854-f113a64008f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.355434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b2b3-8be3-4223-8854-f113a64008f9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.355712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b2b3-8be3-4223-8854-f113a64008f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.355988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0b2b3-8be3-4223-8854-f113a64008f9 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.357520 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0b2b3-8be3-4223-8854-f113a64008f9 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.359351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0b2b3-8be3-4223-8854-f113a64008f9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.362841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 191/372] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:53.365297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0b2b3-8be3-4223-8854-f113a64008f9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.430526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7475c04-fe11-4355-b0d3-f7940a629ca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.432459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7475c04-fe11-4355-b0d3-f7940a629ca7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.475108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0b2b3-8be3-4223-8854-f113a64008f9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.511469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf1e47-daf2-445d-b941-ade28a6d4cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.512254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf1e47-daf2-445d-b941-ade28a6d4cac None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.512540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf1e47-daf2-445d-b941-ade28a6d4cac None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.512821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf1e47-daf2-445d-b941-ade28a6d4cac None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.514049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf1e47-daf2-445d-b941-ade28a6d4cac None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.515578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf1e47-daf2-445d-b941-ade28a6d4cac None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.517523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 192/373] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:53.518982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf1e47-daf2-445d-b941-ade28a6d4cac None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.524914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.546294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 182/374] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:53.548681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7475c04-fe11-4355-b0d3-f7940a629ca7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.594041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.648149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf1e47-daf2-445d-b941-ade28a6d4cac None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.676175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7475c04-fe11-4355-b0d3-f7940a629ca7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.696185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bc997-7bfa-4f15-8072-10bf1ee25fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.697279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bc997-7bfa-4f15-8072-10bf1ee25fcf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.697576 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bc997-7bfa-4f15-8072-10bf1ee25fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.698259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bc997-7bfa-4f15-8072-10bf1ee25fcf None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.699964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bc997-7bfa-4f15-8072-10bf1ee25fcf None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.702059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bc997-7bfa-4f15-8072-10bf1ee25fcf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.705395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 193/375] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:53.706584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bc997-7bfa-4f15-8072-10bf1ee25fcf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.717186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e277e-5368-46a8-af96-05a7db586459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.718935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e277e-5368-46a8-af96-05a7db586459 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.719221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e277e-5368-46a8-af96-05a7db586459 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.719499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e277e-5368-46a8-af96-05a7db586459 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.720341 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e277e-5368-46a8-af96-05a7db586459 None admin] RBAC: Adding query filter params (group.id=8d831d22914f414cabd18e7e97171705, role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:53.720657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e277e-5368-46a8-af96-05a7db586459 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.723968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e277e-5368-46a8-af96-05a7db586459 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.731717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 183/376] 10.222.0.41 () {56 vars in 1376 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/role_assignments?group.id=8d831d22914f414cabd18e7e97171705&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:53.732607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e277e-5368-46a8-af96-05a7db586459 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.796104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.827011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bc997-7bfa-4f15-8072-10bf1ee25fcf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.835317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:53.857577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e277e-5368-46a8-af96-05a7db586459 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:53.865720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04825e8e-f2f6-47b4-b299-038bb2a71a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.866853 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825e8e-f2f6-47b4-b299-038bb2a71a5e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.867322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825e8e-f2f6-47b4-b299-038bb2a71a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.867741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04825e8e-f2f6-47b4-b299-038bb2a71a5e None admin] PATH_INFO: `/v3/projects/787f9c4d2f4e4a9fbcf0543d5d8232c5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.871326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04825e8e-f2f6-47b4-b299-038bb2a71a5e None admin] RBAC: Authorizing `identity:get_project(project_id=787f9c4d2f4e4a9fbcf0543d5d8232c5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.871326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04825e8e-f2f6-47b4-b299-038bb2a71a5e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.873087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 194/377] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/projects/787f9c4d2f4e4a9fbcf0543d5d8232c5 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:53.879018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04825e8e-f2f6-47b4-b299-038bb2a71a5e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:53.915617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd1a41-7e83-40ef-b5cd-0d05b09bff3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:53.916082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd1a41-7e83-40ef-b5cd-0d05b09bff3f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.916376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd1a41-7e83-40ef-b5cd-0d05b09bff3f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.917148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd1a41-7e83-40ef-b5cd-0d05b09bff3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.917512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd1a41-7e83-40ef-b5cd-0d05b09bff3f None admin] RBAC: Adding query filter params (group.id=8d831d22914f414cabd18e7e97171705, role.id=af99020fdd8b4a4e93e3b913d49e9cf8, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:53.917860 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd1a41-7e83-40ef-b5cd-0d05b09bff3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:53.919346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd1a41-7e83-40ef-b5cd-0d05b09bff3f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:53.934045 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 184/378] 10.222.0.41 () {56 vars in 1376 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/role_assignments?group.id=8d831d22914f414cabd18e7e97171705&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=af99020fdd8b4a4e93e3b913d49e9cf8 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:53.972771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d55b-c0eb-4350-b161-f9d99e96a784 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.973064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d55b-c0eb-4350-b161-f9d99e96a784 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.973349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2d55b-c0eb-4350-b161-f9d99e96a784 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:53.976438 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 185/379] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:53.981221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c34d5-71dd-435d-9086-28cfd12cf429 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:53.981515 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c34d5-71dd-435d-9086-28cfd12cf429 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:53.981843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c34d5-71dd-435d-9086-28cfd12cf429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.005590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7c7c34d5-71dd-435d-9086-28cfd12cf429 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:54.006928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7c7c34d5-71dd-435d-9086-28cfd12cf429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:54.019751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04825e8e-f2f6-47b4-b299-038bb2a71a5e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:54.076497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d7850-6c15-424f-978c-e551f32c4374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:54.077219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d7850-6c15-424f-978c-e551f32c4374 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.077350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d7850-6c15-424f-978c-e551f32c4374 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.078538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d7850-6c15-424f-978c-e551f32c4374 None admin] PATH_INFO: `/v3/groups/c8630f9c24044c5c8d6b6a20cba295e7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.099268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d7850-6c15-424f-978c-e551f32c4374 None admin] RBAC: Authorizing `identity:get_group(group_id=c8630f9c24044c5c8d6b6a20cba295e7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:54.101559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d7850-6c15-424f-978c-e551f32c4374 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:54.103915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 195/380] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:53 2022] GET /identity/v3/groups/c8630f9c24044c5c8d6b6a20cba295e7 => generated 229 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:54.110730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d7850-6c15-424f-978c-e551f32c4374 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:54.141803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 186/381] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:54.163852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c34d5-71dd-435d-9086-28cfd12cf429 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:54.215845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:54.218543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:54.293833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c34d5-71dd-435d-9086-28cfd12cf429 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:54.301012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d7850-6c15-424f-978c-e551f32c4374 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:54.343185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9644f-ecc1-4f23-88ec-0a04c2bfba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:54.343903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9644f-ecc1-4f23-88ec-0a04c2bfba85 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.344192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9644f-ecc1-4f23-88ec-0a04c2bfba85 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.344476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9644f-ecc1-4f23-88ec-0a04c2bfba85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.350391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6805a8-4ae9-4c11-acbc-cfcc98c0d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:54.351659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6805a8-4ae9-4c11-acbc-cfcc98c0d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.352147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6805a8-4ae9-4c11-acbc-cfcc98c0d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.352624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6805a8-4ae9-4c11-acbc-cfcc98c0d8e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.353900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6805a8-4ae9-4c11-acbc-cfcc98c0d8e2 None admin] RBAC: Adding query filter params (group.id=c8630f9c24044c5c8d6b6a20cba295e7, role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=787f9c4d2f4e4a9fbcf0543d5d8232c5) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:54.354533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6805a8-4ae9-4c11-acbc-cfcc98c0d8e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:54.356800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6805a8-4ae9-4c11-acbc-cfcc98c0d8e2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:54.357198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9644f-ecc1-4f23-88ec-0a04c2bfba85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:54.364048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 196/382] 10.222.0.41 () {56 vars in 1376 bytes} [Thu May 26 12:23:54 2022] GET /identity/v3/role_assignments?group.id=c8630f9c24044c5c8d6b6a20cba295e7&scope.project.id=787f9c4d2f4e4a9fbcf0543d5d8232c5&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:54.366292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de1a3-1ad2-4d78-92f0-0f846a3cc991 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.366790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de1a3-1ad2-4d78-92f0-0f846a3cc991 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.367269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248de1a3-1ad2-4d78-92f0-0f846a3cc991 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f1c9644f-ecc1-4f23-88ec-0a04c2bfba85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:54.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:54.368364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:54.369151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:54.372416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 197/383] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:54.373830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 187/384] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:54.383093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c79765-8d92-4e96-9c45-167c1a9e46c2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.383740 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c79765-8d92-4e96-9c45-167c1a9e46c2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.384248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c79765-8d92-4e96-9c45-167c1a9e46c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.388921 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9644f-ecc1-4f23-88ec-0a04c2bfba85 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:54.419662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e3c79765-8d92-4e96-9c45-167c1a9e46c2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:54.422037 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e3c79765-8d92-4e96-9c45-167c1a9e46c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:54.561428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 198/385] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:54.587564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c79765-8d92-4e96-9c45-167c1a9e46c2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:54.599805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:54.607103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9644f-ecc1-4f23-88ec-0a04c2bfba85 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:54.647222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:54.677019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e8a1c-574b-4729-ab3c-26dc85ce8bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:54.679431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e8a1c-574b-4729-ab3c-26dc85ce8bcd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.679954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e8a1c-574b-4729-ab3c-26dc85ce8bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.680445 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e8a1c-574b-4729-ab3c-26dc85ce8bcd None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.681461 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e8a1c-574b-4729-ab3c-26dc85ce8bcd None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:54.681990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e8a1c-574b-4729-ab3c-26dc85ce8bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:54.683585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e8a1c-574b-4729-ab3c-26dc85ce8bcd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:54.696198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 188/386] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:54.702752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e8a1c-574b-4729-ab3c-26dc85ce8bcd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:54.822637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c79765-8d92-4e96-9c45-167c1a9e46c2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:54.825970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e8a1c-574b-4729-ab3c-26dc85ce8bcd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:54.867141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f697a94-2560-47e1-89ed-448ad0eb943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:54.868157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f697a94-2560-47e1-89ed-448ad0eb943f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.868669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f697a94-2560-47e1-89ed-448ad0eb943f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.869189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f697a94-2560-47e1-89ed-448ad0eb943f None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.871040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f697a94-2560-47e1-89ed-448ad0eb943f None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:54.873052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f697a94-2560-47e1-89ed-448ad0eb943f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:54.876215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 189/387] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:54 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:54.882743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f697a94-2560-47e1-89ed-448ad0eb943f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:54.893527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5dcbc-0760-4325-be05-c51f77df6ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:54.894717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5dcbc-0760-4325-be05-c51f77df6ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:54.895204 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5dcbc-0760-4325-be05-c51f77df6ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:54.895699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c5dcbc-0760-4325-be05-c51f77df6ec1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:54.920221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:54.921506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c5dcbc-0760-4325-be05-c51f77df6ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c4c5dcbc-0760-4325-be05-c51f77df6ec1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:54.938005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:54.938942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:54.939789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:54.942247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 199/388] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:54.947872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5dcbc-0760-4325-be05-c51f77df6ec1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.004498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f697a94-2560-47e1-89ed-448ad0eb943f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.049006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6b6a8-4cba-4155-8179-7264d053f8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.051019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6b6a8-4cba-4155-8179-7264d053f8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.051312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6b6a8-4cba-4155-8179-7264d053f8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.051598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6b6a8-4cba-4155-8179-7264d053f8e6 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.054323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6b6a8-4cba-4155-8179-7264d053f8e6 None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:55.058165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6b6a8-4cba-4155-8179-7264d053f8e6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:55.059916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 190/389] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:54 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:55.070612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6b6a8-4cba-4155-8179-7264d053f8e6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.113450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:55.126149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c5dcbc-0760-4325-be05-c51f77df6ec1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.169253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e287a59-bf53-42f8-9fd6-ca4f3c4aa79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.169966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287a59-bf53-42f8-9fd6-ca4f3c4aa79f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.170253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287a59-bf53-42f8-9fd6-ca4f3c4aa79f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.170533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e287a59-bf53-42f8-9fd6-ca4f3c4aa79f None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.171325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e287a59-bf53-42f8-9fd6-ca4f3c4aa79f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:55.171632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e287a59-bf53-42f8-9fd6-ca4f3c4aa79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:55.174504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e287a59-bf53-42f8-9fd6-ca4f3c4aa79f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:55.197746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 200/390] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:55.198693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e287a59-bf53-42f8-9fd6-ca4f3c4aa79f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.262085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6b6a8-4cba-4155-8179-7264d053f8e6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.265988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:55.304116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06ccaf-a00e-4da4-bb49-e67a39fe1988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.305112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06ccaf-a00e-4da4-bb49-e67a39fe1988 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.305501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06ccaf-a00e-4da4-bb49-e67a39fe1988 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.305810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06ccaf-a00e-4da4-bb49-e67a39fe1988 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/groups/8d831d22914f414cabd18e7e97171705/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.308041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06ccaf-a00e-4da4-bb49-e67a39fe1988 None admin] RBAC: Authorizing `identity:create_grant(project_id=058eb95aa34c4eed9a28c8cee87c0c14, group_id=8d831d22914f414cabd18e7e97171705, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:55.309607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06ccaf-a00e-4da4-bb49-e67a39fe1988 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:55.320276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e287a59-bf53-42f8-9fd6-ca4f3c4aa79f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.358000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b149-5990-4056-a604-bfdae4e761c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.358900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b149-5990-4056-a604-bfdae4e761c8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.359184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b149-5990-4056-a604-bfdae4e761c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.359464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b149-5990-4056-a604-bfdae4e761c8 None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.360647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863b149-5990-4056-a604-bfdae4e761c8 None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:55.362116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863b149-5990-4056-a604-bfdae4e761c8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:55.363751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 201/391] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:55 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:55.369003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b149-5990-4056-a604-bfdae4e761c8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.399165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:55.405609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 191/392] 10.222.0.41 () {58 vars in 1442 bytes} [Thu May 26 12:23:55 2022] PUT /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/groups/8d831d22914f414cabd18e7e97171705/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:55.478172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b149-5990-4056-a604-bfdae4e761c8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.515601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4badd2fd-ba39-4a05-b12e-26445892eaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.516481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badd2fd-ba39-4a05-b12e-26445892eaff None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.516820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badd2fd-ba39-4a05-b12e-26445892eaff None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.517094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4badd2fd-ba39-4a05-b12e-26445892eaff None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.518397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badd2fd-ba39-4a05-b12e-26445892eaff None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:55.519835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4badd2fd-ba39-4a05-b12e-26445892eaff None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:55.521914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 202/393] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:55 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:55.527563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06ccaf-a00e-4da4-bb49-e67a39fe1988 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.656221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06ccaf-a00e-4da4-bb49-e67a39fe1988 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.699448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23b032-30b4-4fbd-9e4c-d3870a9d6d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.700708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23b032-30b4-4fbd-9e4c-d3870a9d6d43 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.701201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23b032-30b4-4fbd-9e4c-d3870a9d6d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.701709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23b032-30b4-4fbd-9e4c-d3870a9d6d43 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/groups/8d831d22914f414cabd18e7e97171705/roles/af99020fdd8b4a4e93e3b913d49e9cf8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.704854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23b032-30b4-4fbd-9e4c-d3870a9d6d43 None admin] RBAC: Authorizing `identity:create_grant(project_id=058eb95aa34c4eed9a28c8cee87c0c14, group_id=8d831d22914f414cabd18e7e97171705, role_id=af99020fdd8b4a4e93e3b913d49e9cf8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:55.706576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23b032-30b4-4fbd-9e4c-d3870a9d6d43 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:55.777003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 192/394] 10.222.0.41 () {58 vars in 1442 bytes} [Thu May 26 12:23:55 2022] PUT /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14/groups/8d831d22914f414cabd18e7e97171705/roles/af99020fdd8b4a4e93e3b913d49e9cf8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:56.513243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deae092-101d-4fc7-ac60-960fa9c14923 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.513765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deae092-101d-4fc7-ac60-960fa9c14923 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.513868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deae092-101d-4fc7-ac60-960fa9c14923 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.515476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 203/395] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:56.521466 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ed1df-51df-433a-9f0e-b043a0f13a9e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.521929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ed1df-51df-433a-9f0e-b043a0f13a9e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.522103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ed1df-51df-433a-9f0e-b043a0f13a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.544729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a20ed1df-51df-433a-9f0e-b043a0f13a9e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:56.546423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a20ed1df-51df-433a-9f0e-b043a0f13a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:56.551582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19323f33-c3c3-4904-a8b7-45d6911e225c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.551879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19323f33-c3c3-4904-a8b7-45d6911e225c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.561794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19323f33-c3c3-4904-a8b7-45d6911e225c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.561794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 204/396] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:56.561794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54116-5e13-4260-b231-b551857bd229 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.561794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54116-5e13-4260-b231-b551857bd229 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.561794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a54116-5e13-4260-b231-b551857bd229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.562232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.587635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-20a54116-5e13-4260-b231-b551857bd229 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:56.589021 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-20a54116-5e13-4260-b231-b551857bd229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:56.630458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 193/397] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:56.657289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ed1df-51df-433a-9f0e-b043a0f13a9e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.712414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 205/398] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:56.744534 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a54116-5e13-4260-b231-b551857bd229 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.769120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ed1df-51df-433a-9f0e-b043a0f13a9e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.787552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.806894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c301725-17a3-4e98-a683-300533db6f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.807941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301725-17a3-4e98-a683-300533db6f75 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.808392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301725-17a3-4e98-a683-300533db6f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.808813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c301725-17a3-4e98-a683-300533db6f75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.822201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c301725-17a3-4e98-a683-300533db6f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5c301725-17a3-4e98-a683-300533db6f75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:56.830545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:56.831595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:56.832652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:56.835888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 194/399] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:56.841738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c301725-17a3-4e98-a683-300533db6f75 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.857176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:56.955100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c301725-17a3-4e98-a683-300533db6f75 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.975870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a54116-5e13-4260-b231-b551857bd229 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.991030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0966f-e358-4ccf-8600-d17ae802b982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.991964 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0966f-e358-4ccf-8600-d17ae802b982 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.992396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0966f-e358-4ccf-8600-d17ae802b982 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.992814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0966f-e358-4ccf-8600-d17ae802b982 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.993844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0966f-e358-4ccf-8600-d17ae802b982 None admin] RBAC: Adding query filter params (name=member) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:56.994320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0966f-e358-4ccf-8600-d17ae802b982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.996261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0966f-e358-4ccf-8600-d17ae802b982 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:57.006240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 195/400] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:57.012363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0966f-e358-4ccf-8600-d17ae802b982 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:57.086078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:57.086993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea3348-717a-4c4a-addb-8d517fe6fca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:57.087827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea3348-717a-4c4a-addb-8d517fe6fca3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.088116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea3348-717a-4c4a-addb-8d517fe6fca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.088394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea3348-717a-4c4a-addb-8d517fe6fca3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.118775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea3348-717a-4c4a-addb-8d517fe6fca3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:57.125583 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0966f-e358-4ccf-8600-d17ae802b982 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-cfea3348-717a-4c4a-addb-8d517fe6fca3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:57.127758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:57.128855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:57.129756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:57.138168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 206/401] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:57.144282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea3348-717a-4c4a-addb-8d517fe6fca3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:57.165496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827e334-b90e-4b5e-ba21-08d4b89c82aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:57.166619 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e334-b90e-4b5e-ba21-08d4b89c82aa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.167049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e334-b90e-4b5e-ba21-08d4b89c82aa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.167467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e334-b90e-4b5e-ba21-08d4b89c82aa None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.168814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827e334-b90e-4b5e-ba21-08d4b89c82aa None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:57.170496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827e334-b90e-4b5e-ba21-08d4b89c82aa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:57.172879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 196/402] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:57 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:57.178311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827e334-b90e-4b5e-ba21-08d4b89c82aa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:57.288101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827e334-b90e-4b5e-ba21-08d4b89c82aa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:57.347272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb590be3-0f77-4667-82d3-718e1975df68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:57.348396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb590be3-0f77-4667-82d3-718e1975df68 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.349015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:57.350176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb590be3-0f77-4667-82d3-718e1975df68 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.351415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb590be3-0f77-4667-82d3-718e1975df68 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.353719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb590be3-0f77-4667-82d3-718e1975df68 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:57.357322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb590be3-0f77-4667-82d3-718e1975df68 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:57.361727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 197/403] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:57 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:57.368043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb590be3-0f77-4667-82d3-718e1975df68 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:57.386031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:57.389389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea3348-717a-4c4a-addb-8d517fe6fca3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:57.464707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00333147-ddec-44c4-be0a-97e1d49401d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:57.465406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333147-ddec-44c4-be0a-97e1d49401d3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.465709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333147-ddec-44c4-be0a-97e1d49401d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.466145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333147-ddec-44c4-be0a-97e1d49401d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.466924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00333147-ddec-44c4-be0a-97e1d49401d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:57.467236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00333147-ddec-44c4-be0a-97e1d49401d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:57.469385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00333147-ddec-44c4-be0a-97e1d49401d3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:57.479370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 207/404] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:57.487638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00333147-ddec-44c4-be0a-97e1d49401d3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:57.556312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb590be3-0f77-4667-82d3-718e1975df68 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:57.619390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851f7f4-3160-478e-a437-ed20fc4f1407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:57.621451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851f7f4-3160-478e-a437-ed20fc4f1407 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.622901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851f7f4-3160-478e-a437-ed20fc4f1407 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.624022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851f7f4-3160-478e-a437-ed20fc4f1407 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/groups/8d831d22914f414cabd18e7e97171705/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.629081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851f7f4-3160-478e-a437-ed20fc4f1407 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a070bf9ade14aafa5a6b04292868a5c, group_id=8d831d22914f414cabd18e7e97171705, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:57.630787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6851f7f4-3160-478e-a437-ed20fc4f1407 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:57.693069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00333147-ddec-44c4-be0a-97e1d49401d3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:57.728609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b2889-d7eb-4538-88a0-86f617bde56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:57.729775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b2889-d7eb-4538-88a0-86f617bde56f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.730254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b2889-d7eb-4538-88a0-86f617bde56f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.730714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b2889-d7eb-4538-88a0-86f617bde56f None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.732030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b2889-d7eb-4538-88a0-86f617bde56f None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:57.733644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b2889-d7eb-4538-88a0-86f617bde56f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:57.741535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 198/405] 10.222.0.41 () {58 vars in 1442 bytes} [Thu May 26 12:23:57 2022] PUT /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/groups/8d831d22914f414cabd18e7e97171705/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:23:57.743029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dbefb-cd81-4edc-902a-b6865c771f92 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.743554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dbefb-cd81-4edc-902a-b6865c771f92 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.744014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dbefb-cd81-4edc-902a-b6865c771f92 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.745486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 199/406] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:57.746239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 208/407] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:57 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:57.752976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b2889-d7eb-4538-88a0-86f617bde56f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:57.753694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1e0f2-91cb-4e19-a657-ab8f933d31ad None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.754373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1e0f2-91cb-4e19-a657-ab8f933d31ad None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.754747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1e0f2-91cb-4e19-a657-ab8f933d31ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.779473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:57.796452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d1c1e0f2-91cb-4e19-a657-ab8f933d31ad None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:57.799779 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d1c1e0f2-91cb-4e19-a657-ab8f933d31ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:57.889450 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:57.900512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 200/408] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:57.927552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1e0f2-91cb-4e19-a657-ab8f933d31ad None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:57.946630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b2889-d7eb-4538-88a0-86f617bde56f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:57.986857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd971a-f1fd-4a04-acc8-4a0d3d92b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:57.988028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd971a-f1fd-4a04-acc8-4a0d3d92b930 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:57.988466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd971a-f1fd-4a04-acc8-4a0d3d92b930 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:57.988878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd971a-f1fd-4a04-acc8-4a0d3d92b930 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:57.990241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd971a-f1fd-4a04-acc8-4a0d3d92b930 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:57.991920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cd971a-f1fd-4a04-acc8-4a0d3d92b930 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:57.994166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 209/409] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:57 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:58.000163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd971a-f1fd-4a04-acc8-4a0d3d92b930 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:58.099360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1e0f2-91cb-4e19-a657-ab8f933d31ad None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:58.138482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:58.150207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9c99-fe56-4a52-aa3c-2f3ff543870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:58.150207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9c99-fe56-4a52-aa3c-2f3ff543870d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.150207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9c99-fe56-4a52-aa3c-2f3ff543870d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.150207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9c99-fe56-4a52-aa3c-2f3ff543870d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.175485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c9c99-fe56-4a52-aa3c-2f3ff543870d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:58.176346 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd971a-f1fd-4a04-acc8-4a0d3d92b930 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-859c9c99-fe56-4a52-aa3c-2f3ff543870d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:58.196102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:58.197037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:58.197850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 201/410] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:23:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:58.206170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9c99-fe56-4a52-aa3c-2f3ff543870d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:58.222062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6487c5-73b3-4f5b-8621-5954f166a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:58.224257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6487c5-73b3-4f5b-8621-5954f166a09f None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.225808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6487c5-73b3-4f5b-8621-5954f166a09f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.226291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6487c5-73b3-4f5b-8621-5954f166a09f None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/groups/8d831d22914f414cabd18e7e97171705/roles/af99020fdd8b4a4e93e3b913d49e9cf8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.229977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6487c5-73b3-4f5b-8621-5954f166a09f None admin] RBAC: Authorizing `identity:create_grant(project_id=4a070bf9ade14aafa5a6b04292868a5c, group_id=8d831d22914f414cabd18e7e97171705, role_id=af99020fdd8b4a4e93e3b913d49e9cf8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:58.232569 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6487c5-73b3-4f5b-8621-5954f166a09f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:58.282096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:58.331654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 210/411] 10.222.0.41 () {58 vars in 1442 bytes} [Thu May 26 12:23:57 2022] PUT /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c/groups/8d831d22914f414cabd18e7e97171705/roles/af99020fdd8b4a4e93e3b913d49e9cf8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:23:58.336232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9c99-fe56-4a52-aa3c-2f3ff543870d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:58.343052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4edb31-baf6-4a98-a34f-6ecf2f8d253c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.343786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4edb31-baf6-4a98-a34f-6ecf2f8d253c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.344291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4edb31-baf6-4a98-a34f-6ecf2f8d253c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.346249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 211/412] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:58.354276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31b161-4e53-493d-8fad-b301b7a364c4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.354899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31b161-4e53-493d-8fad-b301b7a364c4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.355423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f31b161-4e53-493d-8fad-b301b7a364c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.375300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1f31b161-4e53-493d-8fad-b301b7a364c4 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:58.376825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1f31b161-4e53-493d-8fad-b301b7a364c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:58.399123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a601abf-b7db-4ac0-9a6e-bf9c09c4632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:58.399817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a601abf-b7db-4ac0-9a6e-bf9c09c4632f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.400104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a601abf-b7db-4ac0-9a6e-bf9c09c4632f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.400432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a601abf-b7db-4ac0-9a6e-bf9c09c4632f None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.401147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a601abf-b7db-4ac0-9a6e-bf9c09c4632f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:58.401458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a601abf-b7db-4ac0-9a6e-bf9c09c4632f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:58.402899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a601abf-b7db-4ac0-9a6e-bf9c09c4632f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:58.418056 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 202/413] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:58.423937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a601abf-b7db-4ac0-9a6e-bf9c09c4632f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:58.454544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 212/414] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:23:58.478598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31b161-4e53-493d-8fad-b301b7a364c4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:58.565223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a601abf-b7db-4ac0-9a6e-bf9c09c4632f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:58.589924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:58.605830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7539107-fce9-4b17-96b8-ba3a3e1cbf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:58.606810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7539107-fce9-4b17-96b8-ba3a3e1cbf9f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.607185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7539107-fce9-4b17-96b8-ba3a3e1cbf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.607522 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7539107-fce9-4b17-96b8-ba3a3e1cbf9f None admin] PATH_INFO: `/v3/groups/c8630f9c24044c5c8d6b6a20cba295e7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.609087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7539107-fce9-4b17-96b8-ba3a3e1cbf9f None admin] RBAC: Authorizing `identity:get_group(group_id=c8630f9c24044c5c8d6b6a20cba295e7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:58.611217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7539107-fce9-4b17-96b8-ba3a3e1cbf9f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:58.613363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 203/415] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:58 2022] GET /identity/v3/groups/c8630f9c24044c5c8d6b6a20cba295e7 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:58.621269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7539107-fce9-4b17-96b8-ba3a3e1cbf9f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:58.644333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:58.688256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f31b161-4e53-493d-8fad-b301b7a364c4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:58.728296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780aa853-b61b-4418-ac5f-a9bc988b3aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:58.729103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aa853-b61b-4418-ac5f-a9bc988b3aee None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.729391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aa853-b61b-4418-ac5f-a9bc988b3aee None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.729680 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780aa853-b61b-4418-ac5f-a9bc988b3aee None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.745960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780aa853-b61b-4418-ac5f-a9bc988b3aee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-780aa853-b61b-4418-ac5f-a9bc988b3aee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:58.751030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:58.751857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:23:58.752630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 213/416] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:23:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:23:58.758366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a1c0e-1a62-4faa-835e-005c6e01fb08 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.758715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a1c0e-1a62-4faa-835e-005c6e01fb08 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.759007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a1c0e-1a62-4faa-835e-005c6e01fb08 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.760367 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 214/417] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:23:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:23:58.761074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a1c0e-1a62-4faa-835e-005c6e01fb08 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:58.768971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7539107-fce9-4b17-96b8-ba3a3e1cbf9f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:58.805111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef431b51-0569-4260-b13d-7d268b5cb40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:58.806017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef431b51-0569-4260-b13d-7d268b5cb40b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.806309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef431b51-0569-4260-b13d-7d268b5cb40b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.806590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef431b51-0569-4260-b13d-7d268b5cb40b None admin] PATH_INFO: `/v3/projects/787f9c4d2f4e4a9fbcf0543d5d8232c5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.807871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef431b51-0569-4260-b13d-7d268b5cb40b None admin] RBAC: Authorizing `identity:get_project(project_id=787f9c4d2f4e4a9fbcf0543d5d8232c5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:58.809327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef431b51-0569-4260-b13d-7d268b5cb40b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:58.811363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 204/418] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:58 2022] GET /identity/v3/projects/787f9c4d2f4e4a9fbcf0543d5d8232c5 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:58.813312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0734-fb0d-454e-9a88-a72163240ebb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.813604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0734-fb0d-454e-9a88-a72163240ebb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.813910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13e0734-fb0d-454e-9a88-a72163240ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.830914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c13e0734-fb0d-454e-9a88-a72163240ebb None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:58.832234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c13e0734-fb0d-454e-9a88-a72163240ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:58.869050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a1c0e-1a62-4faa-835e-005c6e01fb08 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:58.884664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:58.900761 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:58.913886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec2de1-dd0f-4e40-acf5-de8e54d4db75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:58.913886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2de1-dd0f-4e40-acf5-de8e54d4db75 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.913886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2de1-dd0f-4e40-acf5-de8e54d4db75 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.913886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec2de1-dd0f-4e40-acf5-de8e54d4db75 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.914272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec2de1-dd0f-4e40-acf5-de8e54d4db75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:58.914272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec2de1-dd0f-4e40-acf5-de8e54d4db75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:58.914272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aec2de1-dd0f-4e40-acf5-de8e54d4db75 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:58.914610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 205/419] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:23:58.915655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e0734-fb0d-454e-9a88-a72163240ebb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:58.920030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 215/420] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:23:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:58.926206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec2de1-dd0f-4e40-acf5-de8e54d4db75 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.037502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec2de1-dd0f-4e40-acf5-de8e54d4db75 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.064962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13e0734-fb0d-454e-9a88-a72163240ebb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.084956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66228204-2407-49cf-873e-54b17366ac84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.085883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228204-2407-49cf-873e-54b17366ac84 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.086369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228204-2407-49cf-873e-54b17366ac84 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.086847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66228204-2407-49cf-873e-54b17366ac84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.108076 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bea5b5-6cc5-47ca-af9a-a09f6dc40cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.109494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea5b5-6cc5-47ca-af9a-a09f6dc40cd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.109799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea5b5-6cc5-47ca-af9a-a09f6dc40cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.110073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bea5b5-6cc5-47ca-af9a-a09f6dc40cd0 None admin] PATH_INFO: `/v3/projects/787f9c4d2f4e4a9fbcf0543d5d8232c5/groups/c8630f9c24044c5c8d6b6a20cba295e7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.112577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bea5b5-6cc5-47ca-af9a-a09f6dc40cd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=787f9c4d2f4e4a9fbcf0543d5d8232c5, group_id=c8630f9c24044c5c8d6b6a20cba295e7, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:59.114384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bea5b5-6cc5-47ca-af9a-a09f6dc40cd0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:59.152813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:59.163683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66228204-2407-49cf-873e-54b17366ac84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:59.165142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66228204-2407-49cf-873e-54b17366ac84 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:59.225689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 206/421] 10.222.0.41 () {58 vars in 1442 bytes} [Thu May 26 12:23:58 2022] PUT /identity/v3/projects/787f9c4d2f4e4a9fbcf0543d5d8232c5/groups/c8630f9c24044c5c8d6b6a20cba295e7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:23:59.225689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bea5b5-6cc5-47ca-af9a-a09f6dc40cd0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.317443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:59.334146 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 216/422] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:23:59.346801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66228204-2407-49cf-873e-54b17366ac84 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.478373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bea5b5-6cc5-47ca-af9a-a09f6dc40cd0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.559153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:59.560260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20551e9c-0045-44fa-bb47-ef43b7a31345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.561078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20551e9c-0045-44fa-bb47-ef43b7a31345 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.561382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20551e9c-0045-44fa-bb47-ef43b7a31345 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.562483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20551e9c-0045-44fa-bb47-ef43b7a31345 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.580176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66228204-2407-49cf-873e-54b17366ac84 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.580474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20551e9c-0045-44fa-bb47-ef43b7a31345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-20551e9c-0045-44fa-bb47-ef43b7a31345 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:23:59.595954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:23:59.596870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:23:59.597771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:23:59.610352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 207/423] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:23:59.611229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20551e9c-0045-44fa-bb47-ef43b7a31345 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.615712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad2cf1-bc72-49c1-98a2-ec8b5703a9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.616819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2cf1-bc72-49c1-98a2-ec8b5703a9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.618256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2cf1-bc72-49c1-98a2-ec8b5703a9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.618747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad2cf1-bc72-49c1-98a2-ec8b5703a9e1 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.620145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad2cf1-bc72-49c1-98a2-ec8b5703a9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:59.622167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad2cf1-bc72-49c1-98a2-ec8b5703a9e1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:59.631473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 217/424] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:59.639209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad2cf1-bc72-49c1-98a2-ec8b5703a9e1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.777138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad2cf1-bc72-49c1-98a2-ec8b5703a9e1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.816467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3b299-82a9-4a11-aa81-b64ebe6de062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.817873 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3b299-82a9-4a11-aa81-b64ebe6de062 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.818381 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3b299-82a9-4a11-aa81-b64ebe6de062 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.818911 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3b299-82a9-4a11-aa81-b64ebe6de062 None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.820639 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3b299-82a9-4a11-aa81-b64ebe6de062 None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:59.822458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3b299-82a9-4a11-aa81-b64ebe6de062 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:59.824796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 218/425] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:59.830881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3b299-82a9-4a11-aa81-b64ebe6de062 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:59.838206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20551e9c-0045-44fa-bb47-ef43b7a31345 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.839737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:59.863374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:23:59.948008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066683de-903a-4269-9315-3d44d35da825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:59.948008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066683de-903a-4269-9315-3d44d35da825 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:59.948008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066683de-903a-4269-9315-3d44d35da825 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:59.948008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066683de-903a-4269-9315-3d44d35da825 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:59.948569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066683de-903a-4269-9315-3d44d35da825 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:23:59.948785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066683de-903a-4269-9315-3d44d35da825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:59.950208 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066683de-903a-4269-9315-3d44d35da825 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:59.974124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 208/426] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:59.977304 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3b299-82a9-4a11-aa81-b64ebe6de062 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:59.985690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066683de-903a-4269-9315-3d44d35da825 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.029807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe50e0f-c0e0-4ee1-a948-446565a7675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.031730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50e0f-c0e0-4ee1-a948-446565a7675d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.033335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50e0f-c0e0-4ee1-a948-446565a7675d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.033921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe50e0f-c0e0-4ee1-a948-446565a7675d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.035066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe50e0f-c0e0-4ee1-a948-446565a7675d None admin] RBAC: Adding query filter params (group.id=8d831d22914f414cabd18e7e97171705, role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:00.035669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe50e0f-c0e0-4ee1-a948-446565a7675d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:00.037767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe50e0f-c0e0-4ee1-a948-446565a7675d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:00.051663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 219/427] 10.222.0.41 () {56 vars in 1376 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/role_assignments?group.id=8d831d22914f414cabd18e7e97171705&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:00.127306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066683de-903a-4269-9315-3d44d35da825 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d8258-24a7-4d53-95d1-ea382f226eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.174110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d8258-24a7-4d53-95d1-ea382f226eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.174396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d8258-24a7-4d53-95d1-ea382f226eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.174674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d8258-24a7-4d53-95d1-ea382f226eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.239101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.289775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d8258-24a7-4d53-95d1-ea382f226eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:00.291290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d8258-24a7-4d53-95d1-ea382f226eb3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:00.398708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 209/428] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:00.403977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe50e0f-c0e0-4ee1-a948-446565a7675d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.478148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13501884-1392-4382-9baa-325a81f076d5 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.478735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13501884-1392-4382-9baa-325a81f076d5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.479229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13501884-1392-4382-9baa-325a81f076d5 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.480773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 210/429] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:00.486382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642acaf6-75f4-4572-b634-b120aef31128 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.486674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642acaf6-75f4-4572-b634-b120aef31128 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.486958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642acaf6-75f4-4572-b634-b120aef31128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.512784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-642acaf6-75f4-4572-b634-b120aef31128 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:00.514018 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-642acaf6-75f4-4572-b634-b120aef31128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:00.547799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.558873 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe50e0f-c0e0-4ee1-a948-446565a7675d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.586843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.597063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 211/430] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:00.605905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9872-4fe3-4fb1-bec7-871512ae0630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.606825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9872-4fe3-4fb1-bec7-871512ae0630 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.607108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9872-4fe3-4fb1-bec7-871512ae0630 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.607384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e9872-4fe3-4fb1-bec7-871512ae0630 None admin] PATH_INFO: `/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.609086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e9872-4fe3-4fb1-bec7-871512ae0630 None admin] RBAC: Authorizing `identity:get_project(project_id=058eb95aa34c4eed9a28c8cee87c0c14)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:00.610859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e9872-4fe3-4fb1-bec7-871512ae0630 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:00.612819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 220/431] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/projects/058eb95aa34c4eed9a28c8cee87c0c14 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:00.618737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642acaf6-75f4-4572-b634-b120aef31128 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.628597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9872-4fe3-4fb1-bec7-871512ae0630 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.747285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642acaf6-75f4-4572-b634-b120aef31128 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.756400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e9872-4fe3-4fb1-bec7-871512ae0630 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.787152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af3d37-9622-4016-9f04-fa190c8cda9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.788142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3d37-9622-4016-9f04-fa190c8cda9b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.788433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3d37-9622-4016-9f04-fa190c8cda9b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.788711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af3d37-9622-4016-9f04-fa190c8cda9b None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.789949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af3d37-9622-4016-9f04-fa190c8cda9b None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:00.791410 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af3d37-9622-4016-9f04-fa190c8cda9b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:00.792768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1252ca-aea4-4460-9e3b-c93a3221e3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.793328 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 212/432] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:00.793579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1252ca-aea4-4460-9e3b-c93a3221e3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.793899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1252ca-aea4-4460-9e3b-c93a3221e3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.794181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1252ca-aea4-4460-9e3b-c93a3221e3c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.803601 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af3d37-9622-4016-9f04-fa190c8cda9b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.817115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1252ca-aea4-4460-9e3b-c93a3221e3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2a1252ca-aea4-4460-9e3b-c93a3221e3c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:00.827815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:00.828820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:00.829629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 221/433] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:00.834666 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1252ca-aea4-4460-9e3b-c93a3221e3c8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:00.871207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.898027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:00.943988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af3d37-9622-4016-9f04-fa190c8cda9b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.981046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1252ca-aea4-4460-9e3b-c93a3221e3c8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:00.994933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4359f9-d417-469d-8da5-aa62150c8ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:00.996014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4359f9-d417-469d-8da5-aa62150c8ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.996426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4359f9-d417-469d-8da5-aa62150c8ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.996725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4359f9-d417-469d-8da5-aa62150c8ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.997635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4359f9-d417-469d-8da5-aa62150c8ff8 None admin] RBAC: Adding query filter params (group.id=8d831d22914f414cabd18e7e97171705, role.id=af99020fdd8b4a4e93e3b913d49e9cf8, scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:00.997966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4359f9-d417-469d-8da5-aa62150c8ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.000213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4359f9-d417-469d-8da5-aa62150c8ff8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.009704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 213/434] 10.222.0.41 () {56 vars in 1376 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/role_assignments?group.id=8d831d22914f414cabd18e7e97171705&scope.project.id=058eb95aa34c4eed9a28c8cee87c0c14&role.id=af99020fdd8b4a4e93e3b913d49e9cf8 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:01.037258 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be8fa9-4f39-48d8-8f5c-837ad51bd4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.038002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8fa9-4f39-48d8-8f5c-837ad51bd4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.038291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8fa9-4f39-48d8-8f5c-837ad51bd4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.038572 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be8fa9-4f39-48d8-8f5c-837ad51bd4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.039350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be8fa9-4f39-48d8-8f5c-837ad51bd4b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:01.039666 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be8fa9-4f39-48d8-8f5c-837ad51bd4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.041087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be8fa9-4f39-48d8-8f5c-837ad51bd4b8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.045725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7612c-5e2d-4c2a-86c1-8229de5842a1 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.046943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7612c-5e2d-4c2a-86c1-8229de5842a1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.046943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7612c-5e2d-4c2a-86c1-8229de5842a1 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.052659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 214/435] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:01.054624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2087b-557e-4564-8625-f2450085b6a0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.054917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2087b-557e-4564-8625-f2450085b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.055197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c2087b-557e-4564-8625-f2450085b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.059486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 222/436] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:01.066637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be8fa9-4f39-48d8-8f5c-837ad51bd4b8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.075498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-55c2087b-557e-4564-8625-f2450085b6a0 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:01.076716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-55c2087b-557e-4564-8625-f2450085b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:01.161860 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 215/437] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:01.178108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.180041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2087b-557e-4564-8625-f2450085b6a0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.200093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be8fa9-4f39-48d8-8f5c-837ad51bd4b8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.246541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.248792 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23650243-8017-44ab-9e96-e2fa758f2255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.249651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23650243-8017-44ab-9e96-e2fa758f2255 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.250146 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23650243-8017-44ab-9e96-e2fa758f2255 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.250437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23650243-8017-44ab-9e96-e2fa758f2255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.298838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c2087b-557e-4564-8625-f2450085b6a0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.339833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23650243-8017-44ab-9e96-e2fa758f2255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.341341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23650243-8017-44ab-9e96-e2fa758f2255 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.341466 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52da7b5-69a3-4e3e-82d0-941083a54462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.342211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52da7b5-69a3-4e3e-82d0-941083a54462 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.342501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52da7b5-69a3-4e3e-82d0-941083a54462 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.342784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52da7b5-69a3-4e3e-82d0-941083a54462 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.355240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52da7b5-69a3-4e3e-82d0-941083a54462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c52da7b5-69a3-4e3e-82d0-941083a54462 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:01.363737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:01.364605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:01.365430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:01.370545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 216/438] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:01.371297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52da7b5-69a3-4e3e-82d0-941083a54462 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.439026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.465239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 223/439] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:24:01.470609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23650243-8017-44ab-9e96-e2fa758f2255 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.501786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52da7b5-69a3-4e3e-82d0-941083a54462 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.519454 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.537590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad191-043c-49f3-b325-69d29e72f86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.538295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad191-043c-49f3-b325-69d29e72f86e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.538587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad191-043c-49f3-b325-69d29e72f86e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.538870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ad191-043c-49f3-b325-69d29e72f86e None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.539679 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ad191-043c-49f3-b325-69d29e72f86e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:01.539936 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ad191-043c-49f3-b325-69d29e72f86e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.541416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ad191-043c-49f3-b325-69d29e72f86e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.552851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 217/440] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:01.558087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad191-043c-49f3-b325-69d29e72f86e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.591084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23650243-8017-44ab-9e96-e2fa758f2255 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.628275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69710ea-8993-4c5f-bacf-6dfffd7f4579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.629139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69710ea-8993-4c5f-bacf-6dfffd7f4579 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.632199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69710ea-8993-4c5f-bacf-6dfffd7f4579 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.632199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69710ea-8993-4c5f-bacf-6dfffd7f4579 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.632199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69710ea-8993-4c5f-bacf-6dfffd7f4579 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.632411 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69710ea-8993-4c5f-bacf-6dfffd7f4579 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.634249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 224/441] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:01.639451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69710ea-8993-4c5f-bacf-6dfffd7f4579 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.664637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ad191-043c-49f3-b325-69d29e72f86e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.692424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.702418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2a348-d0e2-4009-90e1-a35bbba06605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.703268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2a348-d0e2-4009-90e1-a35bbba06605 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.703560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2a348-d0e2-4009-90e1-a35bbba06605 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.703841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2a348-d0e2-4009-90e1-a35bbba06605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.748430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69710ea-8993-4c5f-bacf-6dfffd7f4579 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.754742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.777276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2a348-d0e2-4009-90e1-a35bbba06605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.778820 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2a348-d0e2-4009-90e1-a35bbba06605 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.785847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f349d90-1bf0-43ab-96fa-51ff4c0010a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.786735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f349d90-1bf0-43ab-96fa-51ff4c0010a0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.787232 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f349d90-1bf0-43ab-96fa-51ff4c0010a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.787516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f349d90-1bf0-43ab-96fa-51ff4c0010a0 None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.788825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f349d90-1bf0-43ab-96fa-51ff4c0010a0 None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.790668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f349d90-1bf0-43ab-96fa-51ff4c0010a0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.797592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 225/442] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:01.799080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f349d90-1bf0-43ab-96fa-51ff4c0010a0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.884068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 218/443] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:24:01.889448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2a348-d0e2-4009-90e1-a35bbba06605 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.911613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f349d90-1bf0-43ab-96fa-51ff4c0010a0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.927513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.944441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02f760-d68b-413c-9406-6654e3542f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.945092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02f760-d68b-413c-9406-6654e3542f4f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.945373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02f760-d68b-413c-9406-6654e3542f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.945648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02f760-d68b-413c-9406-6654e3542f4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.946496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02f760-d68b-413c-9406-6654e3542f4f None admin] RBAC: Adding query filter params (group.id=8d831d22914f414cabd18e7e97171705, role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:01.946808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02f760-d68b-413c-9406-6654e3542f4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.948230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02f760-d68b-413c-9406-6654e3542f4f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.954449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 226/444] 10.222.0.41 () {56 vars in 1376 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/role_assignments?group.id=8d831d22914f414cabd18e7e97171705&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:01.975766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29982cfc-f22b-4c4e-9ff0-38122754ca24 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.976104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29982cfc-f22b-4c4e-9ff0-38122754ca24 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.976499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29982cfc-f22b-4c4e-9ff0-38122754ca24 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.977957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 227/445] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:01.983747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a54c3a-b789-49bc-9fa5-47f70b9940d1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.984045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a54c3a-b789-49bc-9fa5-47f70b9940d1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.984307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a54c3a-b789-49bc-9fa5-47f70b9940d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.989240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.001732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-48a54c3a-b789-49bc-9fa5-47f70b9940d1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:02.003080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-48a54c3a-b789-49bc-9fa5-47f70b9940d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:02.011681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2a348-d0e2-4009-90e1-a35bbba06605 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.056633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11d5ec-ca78-4965-b44b-99a27b472cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.057833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11d5ec-ca78-4965-b44b-99a27b472cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.058123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11d5ec-ca78-4965-b44b-99a27b472cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.058398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11d5ec-ca78-4965-b44b-99a27b472cc7 None admin] PATH_INFO: `/v3/projects/4a070bf9ade14aafa5a6b04292868a5c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.060465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11d5ec-ca78-4965-b44b-99a27b472cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=4a070bf9ade14aafa5a6b04292868a5c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.062022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11d5ec-ca78-4965-b44b-99a27b472cc7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.064398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 219/446] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/projects/4a070bf9ade14aafa5a6b04292868a5c => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:02.070087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11d5ec-ca78-4965-b44b-99a27b472cc7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:02.085830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 228/447] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:02.103984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a54c3a-b789-49bc-9fa5-47f70b9940d1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:02.185992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11d5ec-ca78-4965-b44b-99a27b472cc7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.221568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a54c3a-b789-49bc-9fa5-47f70b9940d1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.226682 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13089620-4f0d-4b49-859c-9340099c987e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.227543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13089620-4f0d-4b49-859c-9340099c987e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.227826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13089620-4f0d-4b49-859c-9340099c987e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.228099 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13089620-4f0d-4b49-859c-9340099c987e None admin] PATH_INFO: `/v3/groups/8d831d22914f414cabd18e7e97171705` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.229287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13089620-4f0d-4b49-859c-9340099c987e None admin] RBAC: Authorizing `identity:get_group(group_id=8d831d22914f414cabd18e7e97171705)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.230893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13089620-4f0d-4b49-859c-9340099c987e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.232813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 220/448] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/groups/8d831d22914f414cabd18e7e97171705 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:02.233384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.238894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13089620-4f0d-4b49-859c-9340099c987e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:02.259452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.263949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b882db-6ec2-4cb3-b38f-cb847fb8aeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.264716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b882db-6ec2-4cb3-b38f-cb847fb8aeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.265540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b882db-6ec2-4cb3-b38f-cb847fb8aeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.265861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b882db-6ec2-4cb3-b38f-cb847fb8aeb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.278441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b882db-6ec2-4cb3-b38f-cb847fb8aeb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b4b882db-6ec2-4cb3-b38f-cb847fb8aeb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:02.286147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:02.287044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:02.288195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 229/449] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:02.294360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b882db-6ec2-4cb3-b38f-cb847fb8aeb9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:02.352239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13089620-4f0d-4b49-859c-9340099c987e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.386521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cce70-d0e9-4b93-8a6a-6ca9b3146b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.387180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cce70-d0e9-4b93-8a6a-6ca9b3146b43 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.387464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cce70-d0e9-4b93-8a6a-6ca9b3146b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.387741 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78cce70-d0e9-4b93-8a6a-6ca9b3146b43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.388569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cce70-d0e9-4b93-8a6a-6ca9b3146b43 None admin] RBAC: Adding query filter params (group.id=8d831d22914f414cabd18e7e97171705, role.id=af99020fdd8b4a4e93e3b913d49e9cf8, scope.project.id=4a070bf9ade14aafa5a6b04292868a5c) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:02.388881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cce70-d0e9-4b93-8a6a-6ca9b3146b43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.390417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78cce70-d0e9-4b93-8a6a-6ca9b3146b43 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.396344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 221/450] 10.222.0.41 () {56 vars in 1376 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/role_assignments?group.id=8d831d22914f414cabd18e7e97171705&scope.project.id=4a070bf9ade14aafa5a6b04292868a5c&role.id=af99020fdd8b4a4e93e3b913d49e9cf8 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:02.404401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b882db-6ec2-4cb3-b38f-cb847fb8aeb9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.440931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce4187-fb09-40c1-a290-00004343b6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.441605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4187-fb09-40c1-a290-00004343b6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.441916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4187-fb09-40c1-a290-00004343b6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.442194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce4187-fb09-40c1-a290-00004343b6c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.442944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce4187-fb09-40c1-a290-00004343b6c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:02.443250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce4187-fb09-40c1-a290-00004343b6c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.444633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce4187-fb09-40c1-a290-00004343b6c2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.453922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 230/451] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:02.459661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cce70-d0e9-4b93-8a6a-6ca9b3146b43 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:02.540966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.562788 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78cce70-d0e9-4b93-8a6a-6ca9b3146b43 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.598431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d074d6-2410-424f-82d0-ec245bf56c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.599082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d074d6-2410-424f-82d0-ec245bf56c18 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.599375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d074d6-2410-424f-82d0-ec245bf56c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.599647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d074d6-2410-424f-82d0-ec245bf56c18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.675202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d074d6-2410-424f-82d0-ec245bf56c18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.676686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d074d6-2410-424f-82d0-ec245bf56c18 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.752751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.774887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 222/452] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:02.780988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce4187-fb09-40c1-a290-00004343b6c2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:02.811593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.877287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce4187-fb09-40c1-a290-00004343b6c2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.910883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5955-2030-4042-85c9-c04e13e5478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.911726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5955-2030-4042-85c9-c04e13e5478f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.912013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5955-2030-4042-85c9-c04e13e5478f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.912293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf5955-2030-4042-85c9-c04e13e5478f None admin] PATH_INFO: `/v3/projects/787f9c4d2f4e4a9fbcf0543d5d8232c5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.913456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf5955-2030-4042-85c9-c04e13e5478f None admin] RBAC: Authorizing `identity:get_project(project_id=787f9c4d2f4e4a9fbcf0543d5d8232c5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.914907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf5955-2030-4042-85c9-c04e13e5478f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.916565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 231/453] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/projects/787f9c4d2f4e4a9fbcf0543d5d8232c5 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:02.921985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d074d6-2410-424f-82d0-ec245bf56c18 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.015957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d074d6-2410-424f-82d0-ec245bf56c18 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.048570 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb413796-cf6d-4ba1-adad-f0b39443b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.049398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413796-cf6d-4ba1-adad-f0b39443b6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.049705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413796-cf6d-4ba1-adad-f0b39443b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.049979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb413796-cf6d-4ba1-adad-f0b39443b6c8 None admin] PATH_INFO: `/v3/groups/c8630f9c24044c5c8d6b6a20cba295e7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.051144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb413796-cf6d-4ba1-adad-f0b39443b6c8 None admin] RBAC: Authorizing `identity:get_group(group_id=c8630f9c24044c5c8d6b6a20cba295e7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:03.052573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb413796-cf6d-4ba1-adad-f0b39443b6c8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:03.054162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 223/454] 10.222.0.41 () {56 vars in 1180 bytes} [Thu May 26 12:24:02 2022] GET /identity/v3/groups/c8630f9c24044c5c8d6b6a20cba295e7 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:03.059622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5955-2030-4042-85c9-c04e13e5478f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:03.153285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:03.156607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf5955-2030-4042-85c9-c04e13e5478f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:03.188052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a8683b-4db9-4e81-956f-20ad60aae17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:03.188692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8683b-4db9-4e81-956f-20ad60aae17e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:03.188972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8683b-4db9-4e81-956f-20ad60aae17e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:03.189249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a8683b-4db9-4e81-956f-20ad60aae17e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:03.190093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8683b-4db9-4e81-956f-20ad60aae17e None admin] RBAC: Adding query filter params (group.id=c8630f9c24044c5c8d6b6a20cba295e7, role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=787f9c4d2f4e4a9fbcf0543d5d8232c5) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:03.190405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8683b-4db9-4e81-956f-20ad60aae17e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:03.191825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a8683b-4db9-4e81-956f-20ad60aae17e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:03.197393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 232/455] 10.222.0.41 () {56 vars in 1376 bytes} [Thu May 26 12:24:03 2022] GET /identity/v3/role_assignments?group.id=c8630f9c24044c5c8d6b6a20cba295e7&scope.project.id=787f9c4d2f4e4a9fbcf0543d5d8232c5&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:05.827264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e0f8-d3c3-48e0-8bcd-38e7be020ca4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.827798 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e0f8-d3c3-48e0-8bcd-38e7be020ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.827873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e0f8-d3c3-48e0-8bcd-38e7be020ca4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.829520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 224/456] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:05.834437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9005df-958f-4640-b7dc-9008f50d6d60 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.834815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9005df-958f-4640-b7dc-9008f50d6d60 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.835006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9005df-958f-4640-b7dc-9008f50d6d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.863174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-dc9005df-958f-4640-b7dc-9008f50d6d60 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:05.870438 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-dc9005df-958f-4640-b7dc-9008f50d6d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:05.971444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 233/457] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:06.011017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2e0f8-d3c3-48e0-8bcd-38e7be020ca4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.088942 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.136326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dfa21-b691-4bca-af84-dae941f664d4 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.137005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dfa21-b691-4bca-af84-dae941f664d4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.137484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8dfa21-b691-4bca-af84-dae941f664d4 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.139302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 234/458] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:06.145086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a357b-217b-4752-8765-1711ae9bd3be None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.145608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a357b-217b-4752-8765-1711ae9bd3be None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.146143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a357b-217b-4752-8765-1711ae9bd3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.173036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cd5a357b-217b-4752-8765-1711ae9bd3be None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:06.175760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cd5a357b-217b-4752-8765-1711ae9bd3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:06.188481 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2e0f8-d3c3-48e0-8bcd-38e7be020ca4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.243290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d82f05-f887-4e98-992a-1cf851fbeae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.243627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f05-f887-4e98-992a-1cf851fbeae5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.243900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f05-f887-4e98-992a-1cf851fbeae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.244177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f05-f887-4e98-992a-1cf851fbeae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.255505 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d82f05-f887-4e98-992a-1cf851fbeae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.256919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d82f05-f887-4e98-992a-1cf851fbeae5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-67d82f05-f887-4e98-992a-1cf851fbeae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:06.274613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:06.275509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:06.276320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:06.276320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:06.276320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:06.276320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:06.276320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 225/459] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:06.277336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f516af-9948-4267-850f-b17b7744ba32 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.277624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f516af-9948-4267-850f-b17b7744ba32 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.277914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f516af-9948-4267-850f-b17b7744ba32 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.279443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 226/460] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:06.283987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f516af-9948-4267-850f-b17b7744ba32 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.285502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 235/461] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:06.292240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8eee4-895d-4488-8eb5-415cd3e8d07f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.292240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8eee4-895d-4488-8eb5-415cd3e8d07f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.292240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f8eee4-895d-4488-8eb5-415cd3e8d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.318348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-89f8eee4-895d-4488-8eb5-415cd3e8d07f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:06.319542 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-89f8eee4-895d-4488-8eb5-415cd3e8d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:06.338695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.393785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 236/462] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:06.395213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8eee4-895d-4488-8eb5-415cd3e8d07f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.445394 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.450395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f516af-9948-4267-850f-b17b7744ba32 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.491162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91955bf-1fb3-4ac0-ba2c-bbfb89b4c7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.492686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91955bf-1fb3-4ac0-ba2c-bbfb89b4c7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.493454 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91955bf-1fb3-4ac0-ba2c-bbfb89b4c7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.493956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91955bf-1fb3-4ac0-ba2c-bbfb89b4c7d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.495838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91955bf-1fb3-4ac0-ba2c-bbfb89b4c7d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:06.496467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91955bf-1fb3-4ac0-ba2c-bbfb89b4c7d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.499810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91955bf-1fb3-4ac0-ba2c-bbfb89b4c7d3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.520152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 227/463] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:06.521091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91955bf-1fb3-4ac0-ba2c-bbfb89b4c7d3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.522655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f8eee4-895d-4488-8eb5-415cd3e8d07f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.567594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe760a83-2bb4-4937-8099-a8243fc3870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.568420 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760a83-2bb4-4937-8099-a8243fc3870b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.568771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760a83-2bb4-4937-8099-a8243fc3870b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.569139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe760a83-2bb4-4937-8099-a8243fc3870b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.580546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe760a83-2bb4-4937-8099-a8243fc3870b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.582217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe760a83-2bb4-4937-8099-a8243fc3870b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fe760a83-2bb4-4937-8099-a8243fc3870b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:06.601983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:06.602842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:06.603645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:06.603645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:06.603645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:06.603645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:06.608112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 237/464] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:06.609285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe760a83-2bb4-4937-8099-a8243fc3870b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.618833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.639597 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91955bf-1fb3-4ac0-ba2c-bbfb89b4c7d3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.685744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc9036-f65c-4e38-9893-298d4aee5412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.687256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc9036-f65c-4e38-9893-298d4aee5412 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.688444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc9036-f65c-4e38-9893-298d4aee5412 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.688736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc9036-f65c-4e38-9893-298d4aee5412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.701848 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc9036-f65c-4e38-9893-298d4aee5412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.703662 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc9036-f65c-4e38-9893-298d4aee5412 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.717410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe760a83-2bb4-4937-8099-a8243fc3870b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b6fc9036-f65c-4e38-9893-298d4aee5412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:06.722209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:06.723016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:06.724251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:06.724251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:06.724251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:06.724251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:06.724251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 228/465] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:06.724744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc9036-f65c-4e38-9893-298d4aee5412 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.741957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.757265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f51188-0795-4899-ae59-ba7480b08f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.759259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f51188-0795-4899-ae59-ba7480b08f2a None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.759259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f51188-0795-4899-ae59-ba7480b08f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.759259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f51188-0795-4899-ae59-ba7480b08f2a None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.759259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f51188-0795-4899-ae59-ba7480b08f2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.760798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f51188-0795-4899-ae59-ba7480b08f2a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.830705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc9036-f65c-4e38-9893-298d4aee5412 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.864584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2556f-7e14-46b6-9e98-3fbb4deedc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.865254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2556f-7e14-46b6-9e98-3fbb4deedc2e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.865545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2556f-7e14-46b6-9e98-3fbb4deedc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.865861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2556f-7e14-46b6-9e98-3fbb4deedc2e None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.866586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2556f-7e14-46b6-9e98-3fbb4deedc2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:06.866897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2556f-7e14-46b6-9e98-3fbb4deedc2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.867489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 238/466] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/users => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:06.868303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2556f-7e14-46b6-9e98-3fbb4deedc2e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.869860 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e49e97-dbf7-468a-b1b6-65e142fbcd77 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.870270 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e49e97-dbf7-468a-b1b6-65e142fbcd77 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.870999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e49e97-dbf7-468a-b1b6-65e142fbcd77 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.872515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 239/467] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:06.873556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e49e97-dbf7-468a-b1b6-65e142fbcd77 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.898037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 229/468] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:06.899570 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5fc0e-9773-43f7-8426-74c0c6ce58b5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.899865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5fc0e-9773-43f7-8426-74c0c6ce58b5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.900146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5fc0e-9773-43f7-8426-74c0c6ce58b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.920299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9cd5fc0e-9773-43f7-8426-74c0c6ce58b5 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:06.922376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9cd5fc0e-9773-43f7-8426-74c0c6ce58b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:06.971079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.002958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.008224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 230/469] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:07.009340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5fc0e-9773-43f7-8426-74c0c6ce58b5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.027658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e49e97-dbf7-468a-b1b6-65e142fbcd77 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.086908 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3a193-bf95-4989-9889-ee825a3ef6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.087589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3a193-bf95-4989-9889-ee825a3ef6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.087876 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3a193-bf95-4989-9889-ee825a3ef6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.088159 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b3a193-bf95-4989-9889-ee825a3ef6a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.088891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3a193-bf95-4989-9889-ee825a3ef6a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:07.089200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3a193-bf95-4989-9889-ee825a3ef6a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.090620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b3a193-bf95-4989-9889-ee825a3ef6a5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.104652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 240/470] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:07.105484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3a193-bf95-4989-9889-ee825a3ef6a5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.139318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5fc0e-9773-43f7-8426-74c0c6ce58b5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.176915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da0604-4e8b-40b9-8a12-31431979840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.177590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da0604-4e8b-40b9-8a12-31431979840c None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.177922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da0604-4e8b-40b9-8a12-31431979840c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.178187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da0604-4e8b-40b9-8a12-31431979840c None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.178876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da0604-4e8b-40b9-8a12-31431979840c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.180315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da0604-4e8b-40b9-8a12-31431979840c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.216648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b3a193-bf95-4989-9889-ee825a3ef6a5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.240295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.251833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c669ebf-ce39-46b4-98bf-b1e2edd2c7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.252628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669ebf-ce39-46b4-98bf-b1e2edd2c7ab None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.252916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669ebf-ce39-46b4-98bf-b1e2edd2c7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.253197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c669ebf-ce39-46b4-98bf-b1e2edd2c7ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.263122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c669ebf-ce39-46b4-98bf-b1e2edd2c7ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.264633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c669ebf-ce39-46b4-98bf-b1e2edd2c7ab None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4c669ebf-ce39-46b4-98bf-b1e2edd2c7ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:07.282475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:07.283504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:07.284329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:07.284329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:07.284329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:07.284329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:07.284329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 241/471] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:07.289626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324b554-16b4-40fb-8429-5ae03919ddbd None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.289626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324b554-16b4-40fb-8429-5ae03919ddbd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.289626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324b554-16b4-40fb-8429-5ae03919ddbd None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.289626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 242/472] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:07.289626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324b554-16b4-40fb-8429-5ae03919ddbd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.293213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 231/473] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:24:07 2022] POST /identity/v3/users => generated 248 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:07.294287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da0604-4e8b-40b9-8a12-31431979840c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.364764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.420390 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324b554-16b4-40fb-8429-5ae03919ddbd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.425124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da0604-4e8b-40b9-8a12-31431979840c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.466610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b54be-df1c-43ad-a871-d00423634442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.469445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b54be-df1c-43ad-a871-d00423634442 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.470102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b54be-df1c-43ad-a871-d00423634442 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.470736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b54be-df1c-43ad-a871-d00423634442 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.471776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b54be-df1c-43ad-a871-d00423634442 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.472600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681308f-c493-49fe-8ded-c49bce140082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.473785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b54be-df1c-43ad-a871-d00423634442 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.473897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681308f-c493-49fe-8ded-c49bce140082 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.474211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681308f-c493-49fe-8ded-c49bce140082 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.474560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681308f-c493-49fe-8ded-c49bce140082 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.475371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681308f-c493-49fe-8ded-c49bce140082 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:07.475746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681308f-c493-49fe-8ded-c49bce140082 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.477251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b681308f-c493-49fe-8ded-c49bce140082 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.495856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 232/474] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:07.495856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d797-576e-4f48-93eb-105fdba0aa73 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.495856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d797-576e-4f48-93eb-105fdba0aa73 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.495856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19d797-576e-4f48-93eb-105fdba0aa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.512641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cc19d797-576e-4f48-93eb-105fdba0aa73 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:07.513992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cc19d797-576e-4f48-93eb-105fdba0aa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:07.578822 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 243/475] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:24:07 2022] POST /identity/v3/users => generated 248 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:07.580438 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b54be-df1c-43ad-a871-d00423634442 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.590061 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 233/476] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:07.613398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19d797-576e-4f48-93eb-105fdba0aa73 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.626729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.675662 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.716398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b54be-df1c-43ad-a871-d00423634442 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.765329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19d797-576e-4f48-93eb-105fdba0aa73 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.799224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d421967-e069-4514-bc82-96327634138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.800158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d421967-e069-4514-bc82-96327634138a None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.800573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d421967-e069-4514-bc82-96327634138a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.801047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d421967-e069-4514-bc82-96327634138a None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.801958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d421967-e069-4514-bc82-96327634138a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.804966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d421967-e069-4514-bc82-96327634138a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.815524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffbc2e-090a-4b57-bf79-aebc6766298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.816215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffbc2e-090a-4b57-bf79-aebc6766298c None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.816499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffbc2e-090a-4b57-bf79-aebc6766298c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.816777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffbc2e-090a-4b57-bf79-aebc6766298c None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.817533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffbc2e-090a-4b57-bf79-aebc6766298c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.818971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffbc2e-090a-4b57-bf79-aebc6766298c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.924473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.sql.core [None req-06ffbc2e-090a-4b57-bf79-aebc6766298c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:24:07.924473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 12:24:07.924473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [parameters: {'id': '416923df662a4ba5ad79ea75e7f41aa1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 12:24:07.924473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80393) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-06ffbc2e-090a-4b57-bf79-aebc6766298c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() May 26 12:24:07.941743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return ref.to_dict() May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:24:07.942608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application yield resource May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application next(self.gen) May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise self.value May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application session.commit() May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:24:07.943498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.session.flush() May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application compat.raise_( May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:24:07.944356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:24:07.945212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application conn.query(q) May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application result.read() May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:24:07.947903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [parameters: {'id': '416923df662a4ba5ad79ea75e7f41aa1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:07.949793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 12:24:07.951660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:07.954178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 234/477] 10.222.0.41 () {60 vars in 1131 bytes} [Thu May 26 12:24:07 2022] POST /identity/v3/roles => generated 144 bytes in 330 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:07.954178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffbc2e-090a-4b57-bf79-aebc6766298c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.976150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 244/478] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:24:07 2022] POST /identity/v3/users => generated 249 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:08.087393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffbc2e-090a-4b57-bf79-aebc6766298c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.122686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.134844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b9c26e-af86-435e-85db-8c178a25c5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.135661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c26e-af86-435e-85db-8c178a25c5bd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.139672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c26e-af86-435e-85db-8c178a25c5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.139672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c26e-af86-435e-85db-8c178a25c5bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.156479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b9c26e-af86-435e-85db-8c178a25c5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b5b9c26e-af86-435e-85db-8c178a25c5bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:08.164665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:08.165579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:08.166383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:08.174480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 235/479] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:08.180113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d421967-e069-4514-bc82-96327634138a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:08.310944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:08.330723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d421967-e069-4514-bc82-96327634138a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:08.367151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267610a-dc3c-47a8-9f73-5fb8b9994058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:08.367831 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267610a-dc3c-47a8-9f73-5fb8b9994058 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:08.368115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267610a-dc3c-47a8-9f73-5fb8b9994058 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:08.368392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267610a-dc3c-47a8-9f73-5fb8b9994058 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:08.369197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267610a-dc3c-47a8-9f73-5fb8b9994058 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:08.369739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267610a-dc3c-47a8-9f73-5fb8b9994058 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:08.371646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267610a-dc3c-47a8-9f73-5fb8b9994058 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:08.380967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 245/480] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:09.509246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569a7a-09ce-4a6b-b193-5ab0ebbf6b16 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.510299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569a7a-09ce-4a6b-b193-5ab0ebbf6b16 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.510818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25569a7a-09ce-4a6b-b193-5ab0ebbf6b16 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.512722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 236/481] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:09.518427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43dd6-26c7-4334-b21d-9f404e988a7b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.518852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43dd6-26c7-4334-b21d-9f404e988a7b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.519072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc43dd6-26c7-4334-b21d-9f404e988a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.542663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fcc43dd6-26c7-4334-b21d-9f404e988a7b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:09.543878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fcc43dd6-26c7-4334-b21d-9f404e988a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:09.641287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 246/482] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:09.676152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25569a7a-09ce-4a6b-b193-5ab0ebbf6b16 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:09.810972 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25569a7a-09ce-4a6b-b193-5ab0ebbf6b16 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:09.853609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d118e018-f82d-49fc-ab27-29a2c30d0df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:09.854428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118e018-f82d-49fc-ab27-29a2c30d0df0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.854715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118e018-f82d-49fc-ab27-29a2c30d0df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.854995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d118e018-f82d-49fc-ab27-29a2c30d0df0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.872065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d118e018-f82d-49fc-ab27-29a2c30d0df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-d118e018-f82d-49fc-ab27-29a2c30d0df0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:09.880190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:09.881087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:09.881933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:09.887130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43dd6-26c7-4334-b21d-9f404e988a7b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:09.889553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 237/483] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:10.041171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.071643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc43dd6-26c7-4334-b21d-9f404e988a7b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.127280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1cffd-cf00-4c8b-b318-6925b3aaafdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.127966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1cffd-cf00-4c8b-b318-6925b3aaafdb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.128252 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1cffd-cf00-4c8b-b318-6925b3aaafdb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.128532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1cffd-cf00-4c8b-b318-6925b3aaafdb None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.129291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1cffd-cf00-4c8b-b318-6925b3aaafdb None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:10.129602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1cffd-cf00-4c8b-b318-6925b3aaafdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.131007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1cffd-cf00-4c8b-b318-6925b3aaafdb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.139993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d1718-71e6-46dc-b097-a26f44ad9477 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.140278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d1718-71e6-46dc-b097-a26f44ad9477 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.140556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d1718-71e6-46dc-b097-a26f44ad9477 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.142337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 238/484] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:10.144731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d404ed-a9f1-4de0-b42d-c495945f665b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.145019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d404ed-a9f1-4de0-b42d-c495945f665b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.145296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d404ed-a9f1-4de0-b42d-c495945f665b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.146585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 239/485] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:10.147603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977c6c-ff8a-4e1b-989b-3e6fb78450fa None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.147887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977c6c-ff8a-4e1b-989b-3e6fb78450fa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.148160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977c6c-ff8a-4e1b-989b-3e6fb78450fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.151709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 247/486] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:10.157172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1cffd-cf00-4c8b-b318-6925b3aaafdb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.179948 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-19977c6c-ff8a-4e1b-989b-3e6fb78450fa None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:10.182308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-19977c6c-ff8a-4e1b-989b-3e6fb78450fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:10.215453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.273119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 240/487] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:10.274663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a78a6-ba58-46dc-8c94-cc0501692a67 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.274931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1cffd-cf00-4c8b-b318-6925b3aaafdb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.275146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a78a6-ba58-46dc-8c94-cc0501692a67 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.275514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a78a6-ba58-46dc-8c94-cc0501692a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.303053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5a7a78a6-ba58-46dc-8c94-cc0501692a67 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:10.304474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5a7a78a6-ba58-46dc-8c94-cc0501692a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:10.324621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d44c5-44f1-4764-8ec8-bbbbb049475d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.325474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d44c5-44f1-4764-8ec8-bbbbb049475d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.325893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d44c5-44f1-4764-8ec8-bbbbb049475d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.326265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d44c5-44f1-4764-8ec8-bbbbb049475d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.336053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.339960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d44c5-44f1-4764-8ec8-bbbbb049475d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.341464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d44c5-44f1-4764-8ec8-bbbbb049475d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b38d44c5-44f1-4764-8ec8-bbbbb049475d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:10.361776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:10.362654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:10.363763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:10.363763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:10.363763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:10.363763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:10.365525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 248/488] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:10.366470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d44c5-44f1-4764-8ec8-bbbbb049475d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.393696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 241/489] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:10.393696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a78a6-ba58-46dc-8c94-cc0501692a67 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.496652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.509335 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a78a6-ba58-46dc-8c94-cc0501692a67 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.516916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d44c5-44f1-4764-8ec8-bbbbb049475d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.546179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed290bf-b9a8-4fc8-aeab-056103e7a0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.547240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed290bf-b9a8-4fc8-aeab-056103e7a0be None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.547723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed290bf-b9a8-4fc8-aeab-056103e7a0be None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.548218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed290bf-b9a8-4fc8-aeab-056103e7a0be None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.549196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed290bf-b9a8-4fc8-aeab-056103e7a0be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:10.549741 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed290bf-b9a8-4fc8-aeab-056103e7a0be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.551696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed290bf-b9a8-4fc8-aeab-056103e7a0be None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.553305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a4a6-797c-4461-9819-19ce101613ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.554177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a4a6-797c-4461-9819-19ce101613ce None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.554459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a4a6-797c-4461-9819-19ce101613ce None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.554738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a4a6-797c-4461-9819-19ce101613ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.567299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 242/490] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:10.567488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a4a6-797c-4461-9819-19ce101613ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:10.568600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed290bf-b9a8-4fc8-aeab-056103e7a0be None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2901a4a6-797c-4461-9819-19ce101613ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:10.580591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:10.581523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:10.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:10.585953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 249/491] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:10.586834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a4a6-797c-4461-9819-19ce101613ce None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.644452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.679400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed290bf-b9a8-4fc8-aeab-056103e7a0be None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.697288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a4a6-797c-4461-9819-19ce101613ce None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.716083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a60406-f5bb-401b-8672-fa0401b7fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.717258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a60406-f5bb-401b-8672-fa0401b7fcbb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.717824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a60406-f5bb-401b-8672-fa0401b7fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.718299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a60406-f5bb-401b-8672-fa0401b7fcbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.730308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a60406-f5bb-401b-8672-fa0401b7fcbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-88a60406-f5bb-401b-8672-fa0401b7fcbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:10.738701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:10.739622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:10.740375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:10.747301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 243/492] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:10.747301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a60406-f5bb-401b-8672-fa0401b7fcbb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.748256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c242-e66a-4271-b792-f3fa4fbc7d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.749684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c242-e66a-4271-b792-f3fa4fbc7d3f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.749982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c242-e66a-4271-b792-f3fa4fbc7d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.750257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644c242-e66a-4271-b792-f3fa4fbc7d3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.758825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644c242-e66a-4271-b792-f3fa4fbc7d3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.760274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644c242-e66a-4271-b792-f3fa4fbc7d3f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.762789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e644c242-e66a-4271-b792-f3fa4fbc7d3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:10.775527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:10.785237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 250/493] 10.222.0.41 () {56 vars in 1093 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:10.786161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c242-e66a-4271-b792-f3fa4fbc7d3f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.859169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a60406-f5bb-401b-8672-fa0401b7fcbb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.883667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644c242-e66a-4271-b792-f3fa4fbc7d3f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.894787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a797fdf-3166-4548-843c-35e2c6453e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.895457 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797fdf-3166-4548-843c-35e2c6453e62 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.895742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797fdf-3166-4548-843c-35e2c6453e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.896024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a797fdf-3166-4548-843c-35e2c6453e62 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.896759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797fdf-3166-4548-843c-35e2c6453e62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:10.897066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797fdf-3166-4548-843c-35e2c6453e62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.897920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.898487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a797fdf-3166-4548-843c-35e2c6453e62 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.910839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 244/494] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:10.910839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c3a2-298e-498c-b3d7-d5a29561f28f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.910839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c3a2-298e-498c-b3d7-d5a29561f28f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.910839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6c3a2-298e-498c-b3d7-d5a29561f28f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.910839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 245/495] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:10.910839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6c3a2-298e-498c-b3d7-d5a29561f28f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.924641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11097afe-27dc-43ef-b7a7-38cd7afa79ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.925305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11097afe-27dc-43ef-b7a7-38cd7afa79ae None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.925602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11097afe-27dc-43ef-b7a7-38cd7afa79ae None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.925895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11097afe-27dc-43ef-b7a7-38cd7afa79ae None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.926650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11097afe-27dc-43ef-b7a7-38cd7afa79ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:10.926956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11097afe-27dc-43ef-b7a7-38cd7afa79ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.928326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11097afe-27dc-43ef-b7a7-38cd7afa79ae None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.937728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 251/496] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:10.938718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11097afe-27dc-43ef-b7a7-38cd7afa79ae None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.997137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:11.028502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6c3a2-298e-498c-b3d7-d5a29561f28f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.047244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11097afe-27dc-43ef-b7a7-38cd7afa79ae None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.068615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e96b4-b866-4343-8f56-ddd13ac36c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.069295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e96b4-b866-4343-8f56-ddd13ac36c56 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.069579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e96b4-b866-4343-8f56-ddd13ac36c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.069877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e96b4-b866-4343-8f56-ddd13ac36c56 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.070708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e96b4-b866-4343-8f56-ddd13ac36c56 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:11.071016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e96b4-b866-4343-8f56-ddd13ac36c56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.072463 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e96b4-b866-4343-8f56-ddd13ac36c56 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.090250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08652413-b0a0-4c36-b31e-a8ee22deea29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.091056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08652413-b0a0-4c36-b31e-a8ee22deea29 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.091343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08652413-b0a0-4c36-b31e-a8ee22deea29 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.091623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08652413-b0a0-4c36-b31e-a8ee22deea29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.102932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08652413-b0a0-4c36-b31e-a8ee22deea29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.104401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08652413-b0a0-4c36-b31e-a8ee22deea29 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.120698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 246/497] 10.222.0.41 () {56 vars in 1133 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:11.120698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3f8ca-62f0-44a7-b37d-d148d79d9d66 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.120698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3f8ca-62f0-44a7-b37d-d148d79d9d66 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.120698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3f8ca-62f0-44a7-b37d-d148d79d9d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-08652413-b0a0-4c36-b31e-a8ee22deea29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:11.124893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:11.125810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:11.126686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:11.126686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:11.126686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:11.126686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:11.126686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 252/498] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:11.127730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08652413-b0a0-4c36-b31e-a8ee22deea29 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.143891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-81f3f8ca-62f0-44a7-b37d-d148d79d9d66 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:11.145283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-81f3f8ca-62f0-44a7-b37d-d148d79d9d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:11.158309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:11.222479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 247/499] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:11.223612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3f8ca-62f0-44a7-b37d-d148d79d9d66 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.255249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08652413-b0a0-4c36-b31e-a8ee22deea29 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.291216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df32d87-53dc-4d0a-abfb-cbe4b5e41465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.292009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df32d87-53dc-4d0a-abfb-cbe4b5e41465 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.292300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df32d87-53dc-4d0a-abfb-cbe4b5e41465 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.292756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df32d87-53dc-4d0a-abfb-cbe4b5e41465 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.293599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:11.303825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df32d87-53dc-4d0a-abfb-cbe4b5e41465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.305283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df32d87-53dc-4d0a-abfb-cbe4b5e41465 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4df32d87-53dc-4d0a-abfb-cbe4b5e41465 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:11.323579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:11.324489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:11.325331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:11.325331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:11.325331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:11.325331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:11.329118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 253/500] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:11.329950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df32d87-53dc-4d0a-abfb-cbe4b5e41465 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.335626 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3f8ca-62f0-44a7-b37d-d148d79d9d66 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.369347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f69a0-b83c-44b7-9e18-5dcc6e896475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.370036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f69a0-b83c-44b7-9e18-5dcc6e896475 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.370333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f69a0-b83c-44b7-9e18-5dcc6e896475 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.370912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f69a0-b83c-44b7-9e18-5dcc6e896475 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.406766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:11.428755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df32d87-53dc-4d0a-abfb-cbe4b5e41465 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.437285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f69a0-b83c-44b7-9e18-5dcc6e896475 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.438811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f69a0-b83c-44b7-9e18-5dcc6e896475 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.462933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950ad6-6edc-4e77-bb78-18d23460dc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.463787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950ad6-6edc-4e77-bb78-18d23460dc8b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.464073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950ad6-6edc-4e77-bb78-18d23460dc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.464356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8950ad6-6edc-4e77-bb78-18d23460dc8b None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.465076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8950ad6-6edc-4e77-bb78-18d23460dc8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:11.465383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8950ad6-6edc-4e77-bb78-18d23460dc8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.466801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8950ad6-6edc-4e77-bb78-18d23460dc8b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.477699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 254/501] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:11.478490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950ad6-6edc-4e77-bb78-18d23460dc8b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.494967 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:11.535117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 248/502] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:11.537221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a6bf-4272-4269-bbac-d179e55aecdd None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.537519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a6bf-4272-4269-bbac-d179e55aecdd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.537831 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698a6bf-4272-4269-bbac-d179e55aecdd None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.539173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 249/503] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:11.540141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698a6bf-4272-4269-bbac-d179e55aecdd None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.578272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8950ad6-6edc-4e77-bb78-18d23460dc8b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.612116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22c860-1f68-4df0-b7e4-e90ab00c8b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.612977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22c860-1f68-4df0-b7e4-e90ab00c8b30 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.613270 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22c860-1f68-4df0-b7e4-e90ab00c8b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.613553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22c860-1f68-4df0-b7e4-e90ab00c8b30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.620679 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:11.625655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22c860-1f68-4df0-b7e4-e90ab00c8b30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9b22c860-1f68-4df0-b7e4-e90ab00c8b30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:11.633093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:11.633991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:11.634800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 255/504] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:11.635965 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22c860-1f68-4df0-b7e4-e90ab00c8b30 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.643228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698a6bf-4272-4269-bbac-d179e55aecdd None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.678223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf281-2a08-4922-9512-0ef82ab01282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.678892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf281-2a08-4922-9512-0ef82ab01282 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.679186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf281-2a08-4922-9512-0ef82ab01282 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.679470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcf281-2a08-4922-9512-0ef82ab01282 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.680196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcf281-2a08-4922-9512-0ef82ab01282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:11.680507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcf281-2a08-4922-9512-0ef82ab01282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.681925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcf281-2a08-4922-9512-0ef82ab01282 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.693441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 250/505] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:11.694256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf281-2a08-4922-9512-0ef82ab01282 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.715682 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:11.737482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22c860-1f68-4df0-b7e4-e90ab00c8b30 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.770834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c14f03a-f016-41d4-b7b6-3dbeb653b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.771626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14f03a-f016-41d4-b7b6-3dbeb653b67d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.771910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14f03a-f016-41d4-b7b6-3dbeb653b67d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.772187 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14f03a-f016-41d4-b7b6-3dbeb653b67d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.779207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14f03a-f016-41d4-b7b6-3dbeb653b67d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.781195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c14f03a-f016-41d4-b7b6-3dbeb653b67d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.793365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcf281-2a08-4922-9512-0ef82ab01282 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4c14f03a-f016-41d4-b7b6-3dbeb653b67d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:11.795428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:11.796909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:11.797789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 256/506] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:11.798399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85ec2c-35cd-4844-b24c-6d1b0579aa5b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.798689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85ec2c-35cd-4844-b24c-6d1b0579aa5b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.798976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85ec2c-35cd-4844-b24c-6d1b0579aa5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.815694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7a85ec2c-35cd-4844-b24c-6d1b0579aa5b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:11.817186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7a85ec2c-35cd-4844-b24c-6d1b0579aa5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:11.831465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c223b-8d7c-4c72-a7ce-a3e24f5720d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.832249 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c223b-8d7c-4c72-a7ce-a3e24f5720d8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.832534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c223b-8d7c-4c72-a7ce-a3e24f5720d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.832816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c223b-8d7c-4c72-a7ce-a3e24f5720d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:11.843802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c223b-8d7c-4c72-a7ce-a3e24f5720d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:11.845273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c223b-8d7c-4c72-a7ce-a3e24f5720d8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a64c223b-8d7c-4c72-a7ce-a3e24f5720d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:11.862415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:11.863213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:11.868649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:11.868649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:11.868649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:11.868649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:11.868649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 251/507] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:11.868649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c223b-8d7c-4c72-a7ce-a3e24f5720d8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.869971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:11.883372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 257/508] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:11.884140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85ec2c-35cd-4844-b24c-6d1b0579aa5b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:11.935487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:11.964332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c223b-8d7c-4c72-a7ce-a3e24f5720d8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.993777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85ec2c-35cd-4844-b24c-6d1b0579aa5b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:11.998172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182b74-87cf-4232-9a4c-49991ed97659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:11.998886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182b74-87cf-4232-9a4c-49991ed97659 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:11.999179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182b74-87cf-4232-9a4c-49991ed97659 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:11.999463 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31182b74-87cf-4232-9a4c-49991ed97659 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.000217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182b74-87cf-4232-9a4c-49991ed97659 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:12.000533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182b74-87cf-4232-9a4c-49991ed97659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.002055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31182b74-87cf-4232-9a4c-49991ed97659 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.009773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 252/509] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.010547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182b74-87cf-4232-9a4c-49991ed97659 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.031562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7204c7-10db-4ac1-94fc-07a512b09e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.032360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7204c7-10db-4ac1-94fc-07a512b09e7e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.032648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7204c7-10db-4ac1-94fc-07a512b09e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.032930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7204c7-10db-4ac1-94fc-07a512b09e7e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.039907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7204c7-10db-4ac1-94fc-07a512b09e7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.041467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7204c7-10db-4ac1-94fc-07a512b09e7e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8b7204c7-10db-4ac1-94fc-07a512b09e7e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:12.055733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:12.056592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:12.057497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 258/510] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:12.058330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7204c7-10db-4ac1-94fc-07a512b09e7e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.107748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.112789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31182b74-87cf-4232-9a4c-49991ed97659 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.145032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a4be-6473-4d21-b29d-b1cb434b797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.145627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a4be-6473-4d21-b29d-b1cb434b797f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.145940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a4be-6473-4d21-b29d-b1cb434b797f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.146221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c003a4be-6473-4d21-b29d-b1cb434b797f None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.147041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a4be-6473-4d21-b29d-b1cb434b797f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:12.147349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a4be-6473-4d21-b29d-b1cb434b797f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.148778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c003a4be-6473-4d21-b29d-b1cb434b797f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.150358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.157440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7204c7-10db-4ac1-94fc-07a512b09e7e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.166524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 253/511] 10.222.0.41 () {56 vars in 1137 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.167324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a4be-6473-4d21-b29d-b1cb434b797f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.191633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7874ab-9812-45c8-8e46-e3278a5f76ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.192285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7874ab-9812-45c8-8e46-e3278a5f76ab None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.192565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7874ab-9812-45c8-8e46-e3278a5f76ab None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.192841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7874ab-9812-45c8-8e46-e3278a5f76ab None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.193551 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7874ab-9812-45c8-8e46-e3278a5f76ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:12.193886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7874ab-9812-45c8-8e46-e3278a5f76ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.195238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7874ab-9812-45c8-8e46-e3278a5f76ab None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.206640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 259/512] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.207454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7874ab-9812-45c8-8e46-e3278a5f76ab None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.268685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c003a4be-6473-4d21-b29d-b1cb434b797f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.301689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02127acb-dd45-454e-ad9f-ccb4f2db2c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.302460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7874ab-9812-45c8-8e46-e3278a5f76ab None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.302560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127acb-dd45-454e-ad9f-ccb4f2db2c99 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.302756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127acb-dd45-454e-ad9f-ccb4f2db2c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.303038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02127acb-dd45-454e-ad9f-ccb4f2db2c99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.311178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.313178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02127acb-dd45-454e-ad9f-ccb4f2db2c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.314664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02127acb-dd45-454e-ad9f-ccb4f2db2c99 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-02127acb-dd45-454e-ad9f-ccb4f2db2c99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:12.332384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:12.333182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:12.334024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:12.334024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:12.334024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:12.334024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:12.334024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 254/513] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:12.334407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02127acb-dd45-454e-ad9f-ccb4f2db2c99 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.339158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07ea8-679a-4851-940f-26e79a3445be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.339949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07ea8-679a-4851-940f-26e79a3445be None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.340233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07ea8-679a-4851-940f-26e79a3445be None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.340515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e07ea8-679a-4851-940f-26e79a3445be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.352211 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e07ea8-679a-4851-940f-26e79a3445be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.353651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e07ea8-679a-4851-940f-26e79a3445be None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-11e07ea8-679a-4851-940f-26e79a3445be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:12.370082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:12.371145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:12.371954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:12.371954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:12.371954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:12.371954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:12.371954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 260/514] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:12.372365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07ea8-679a-4851-940f-26e79a3445be None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.388052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.442082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02127acb-dd45-454e-ad9f-ccb4f2db2c99 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.470570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e07ea8-679a-4851-940f-26e79a3445be None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.475476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c85b2-9963-48cb-92f1-c9613ac228eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.476147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c85b2-9963-48cb-92f1-c9613ac228eb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.476440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c85b2-9963-48cb-92f1-c9613ac228eb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.476725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c85b2-9963-48cb-92f1-c9613ac228eb None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.477565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c85b2-9963-48cb-92f1-c9613ac228eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:12.477908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c85b2-9963-48cb-92f1-c9613ac228eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.479350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c85b2-9963-48cb-92f1-c9613ac228eb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.497564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 255/515] 10.222.0.41 () {56 vars in 1137 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.498391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c85b2-9963-48cb-92f1-c9613ac228eb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.504607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f752274-cc09-4708-a8b3-a299bcb19b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.505254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f752274-cc09-4708-a8b3-a299bcb19b7e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.505537 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f752274-cc09-4708-a8b3-a299bcb19b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.505847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f752274-cc09-4708-a8b3-a299bcb19b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.533856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.576185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f752274-cc09-4708-a8b3-a299bcb19b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.578327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f752274-cc09-4708-a8b3-a299bcb19b7e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.596368 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c85b2-9963-48cb-92f1-c9613ac228eb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.598633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.630042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2875e-b832-43df-a56d-f058add90b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.630830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2875e-b832-43df-a56d-f058add90b6e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.631142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2875e-b832-43df-a56d-f058add90b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.631417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2875e-b832-43df-a56d-f058add90b6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.638670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2875e-b832-43df-a56d-f058add90b6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.640691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2875e-b832-43df-a56d-f058add90b6e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-92b2875e-b832-43df-a56d-f058add90b6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:12.654890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:12.655766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:12.666799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:12.666799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:12.666799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:12.666799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:12.666799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:12.666799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:12.666799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:12.666799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:12.666799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 256/516] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:12.666799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2875e-b832-43df-a56d-f058add90b6e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.676572 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 261/517] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:12.677415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f752274-cc09-4708-a8b3-a299bcb19b7e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.735289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.762108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2875e-b832-43df-a56d-f058add90b6e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.775883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f752274-cc09-4708-a8b3-a299bcb19b7e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.794393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d368a-cc03-46a6-bfba-863ac3b75023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.795065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d368a-cc03-46a6-bfba-863ac3b75023 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.795355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d368a-cc03-46a6-bfba-863ac3b75023 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.796140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d368a-cc03-46a6-bfba-863ac3b75023 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.796859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d368a-cc03-46a6-bfba-863ac3b75023 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:12.797173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d368a-cc03-46a6-bfba-863ac3b75023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.798577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d368a-cc03-46a6-bfba-863ac3b75023 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.808630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fbcd1-4e9b-40fd-8522-aee363e2611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.809281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbcd1-4e9b-40fd-8522-aee363e2611d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.809567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbcd1-4e9b-40fd-8522-aee363e2611d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.809880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78fbcd1-4e9b-40fd-8522-aee363e2611d None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.810092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 257/518] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.810603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fbcd1-4e9b-40fd-8522-aee363e2611d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:12.810883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d368a-cc03-46a6-bfba-863ac3b75023 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.810971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fbcd1-4e9b-40fd-8522-aee363e2611d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.812944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78fbcd1-4e9b-40fd-8522-aee363e2611d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.824288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 262/519] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.825150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fbcd1-4e9b-40fd-8522-aee363e2611d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.840467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.914941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d368a-cc03-46a6-bfba-863ac3b75023 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.924199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78fbcd1-4e9b-40fd-8522-aee363e2611d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.943731 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.949112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40ef40-b2e9-471c-a0b0-f1d63c24fcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.949797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40ef40-b2e9-471c-a0b0-f1d63c24fcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.950093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40ef40-b2e9-471c-a0b0-f1d63c24fcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.950372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40ef40-b2e9-471c-a0b0-f1d63c24fcb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.957227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d628d-7918-4888-b40b-372de2bdef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.957902 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d628d-7918-4888-b40b-372de2bdef49 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.958192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d628d-7918-4888-b40b-372de2bdef49 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.958784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d628d-7918-4888-b40b-372de2bdef49 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.959252 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d628d-7918-4888-b40b-372de2bdef49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:12.959564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d628d-7918-4888-b40b-372de2bdef49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.960999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d628d-7918-4888-b40b-372de2bdef49 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.978901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 263/520] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.979801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d628d-7918-4888-b40b-372de2bdef49 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.019391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40ef40-b2e9-471c-a0b0-f1d63c24fcb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.020779 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40ef40-b2e9-471c-a0b0-f1d63c24fcb0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.043176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.078549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d628d-7918-4888-b40b-372de2bdef49 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.112762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f0048-506e-4fa3-9d3c-9a2482cb7b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.113637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f0048-506e-4fa3-9d3c-9a2482cb7b85 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.114025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f0048-506e-4fa3-9d3c-9a2482cb7b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.114313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f0048-506e-4fa3-9d3c-9a2482cb7b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.121861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 258/521] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:13.122678 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40ef40-b2e9-471c-a0b0-f1d63c24fcb0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.128481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f0048-506e-4fa3-9d3c-9a2482cb7b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.129983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f0048-506e-4fa3-9d3c-9a2482cb7b85 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-675f0048-506e-4fa3-9d3c-9a2482cb7b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:13.147448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:13.148377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:13.149176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:13.149176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:13.149176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:13.149176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:13.149176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 264/522] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:13.149423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f0048-506e-4fa3-9d3c-9a2482cb7b85 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.180714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.223499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40ef40-b2e9-471c-a0b0-f1d63c24fcb0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.246348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.247030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f0048-506e-4fa3-9d3c-9a2482cb7b85 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.258094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528a663-78fa-41ae-9559-9afcd2ca3a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.258840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528a663-78fa-41ae-9559-9afcd2ca3a08 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.259130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528a663-78fa-41ae-9559-9afcd2ca3a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.259411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528a663-78fa-41ae-9559-9afcd2ca3a08 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.260115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528a663-78fa-41ae-9559-9afcd2ca3a08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.261547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528a663-78fa-41ae-9559-9afcd2ca3a08 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.282144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd62f41-c86c-4bad-be7f-08774228bcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.282869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd62f41-c86c-4bad-be7f-08774228bcc2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.283164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd62f41-c86c-4bad-be7f-08774228bcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.283454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd62f41-c86c-4bad-be7f-08774228bcc2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.290311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd62f41-c86c-4bad-be7f-08774228bcc2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.291745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd62f41-c86c-4bad-be7f-08774228bcc2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fdd62f41-c86c-4bad-be7f-08774228bcc2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:13.305811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:13.306855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 265/523] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:13.307814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd62f41-c86c-4bad-be7f-08774228bcc2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.395032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.399063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 259/524] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:24:13 2022] POST /identity/v3/users => generated 247 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:13.399885 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528a663-78fa-41ae-9559-9afcd2ca3a08 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.403782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd62f41-c86c-4bad-be7f-08774228bcc2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.442517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6f25-065d-4c8c-948c-1a1cd0ce954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.443286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6f25-065d-4c8c-948c-1a1cd0ce954f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.443575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6f25-065d-4c8c-948c-1a1cd0ce954f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.443856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de6f25-065d-4c8c-948c-1a1cd0ce954f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.444765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de6f25-065d-4c8c-948c-1a1cd0ce954f None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=a1e4a66515654e1f9f7452740ff4ce58) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:13.445092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de6f25-065d-4c8c-948c-1a1cd0ce954f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.446653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de6f25-065d-4c8c-948c-1a1cd0ce954f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.458916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 266/525] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/role_assignments?user.id=a1e4a66515654e1f9f7452740ff4ce58&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:13.460019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6f25-065d-4c8c-948c-1a1cd0ce954f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.537478 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528a663-78fa-41ae-9559-9afcd2ca3a08 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.580231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebd25b-9f05-4dff-a49a-a4c5162f31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.581096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebd25b-9f05-4dff-a49a-a4c5162f31ab None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.581384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebd25b-9f05-4dff-a49a-a4c5162f31ab None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.581686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebd25b-9f05-4dff-a49a-a4c5162f31ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.597555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebd25b-9f05-4dff-a49a-a4c5162f31ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.600266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebd25b-9f05-4dff-a49a-a4c5162f31ab None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.615829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de6f25-065d-4c8c-948c-1a1cd0ce954f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-afebd25b-9f05-4dff-a49a-a4c5162f31ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:13.627637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:13.628726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:13.629787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:13.629787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:13.629787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:13.629787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:13.630766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 260/526] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:13.631660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebd25b-9f05-4dff-a49a-a4c5162f31ab None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.667567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3a035-9021-45df-a120-79ead99ac181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.668215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.668732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3a035-9021-45df-a120-79ead99ac181 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.669202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3a035-9021-45df-a120-79ead99ac181 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.669969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3a035-9021-45df-a120-79ead99ac181 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.670816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3a035-9021-45df-a120-79ead99ac181 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:13.671228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3a035-9021-45df-a120-79ead99ac181 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.673261 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3a035-9021-45df-a120-79ead99ac181 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.685470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 267/527] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:13.686597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3a035-9021-45df-a120-79ead99ac181 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.710126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.760491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebd25b-9f05-4dff-a49a-a4c5162f31ab None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.802642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3a035-9021-45df-a120-79ead99ac181 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.804327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cae1f-c1c0-4398-95fd-85d2e9e5ad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.805311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cae1f-c1c0-4398-95fd-85d2e9e5ad2f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.806288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cae1f-c1c0-4398-95fd-85d2e9e5ad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.806398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cae1f-c1c0-4398-95fd-85d2e9e5ad2f None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.807233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cae1f-c1c0-4398-95fd-85d2e9e5ad2f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:13.807556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cae1f-c1c0-4398-95fd-85d2e9e5ad2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.809021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cae1f-c1c0-4398-95fd-85d2e9e5ad2f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.832419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 261/528] 10.222.0.41 () {56 vars in 1139 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:13.837799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cae1f-c1c0-4398-95fd-85d2e9e5ad2f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.853608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fb72c-78e6-4831-a296-ef83007cd0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:13.854335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fb72c-78e6-4831-a296-ef83007cd0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:13.854622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fb72c-78e6-4831-a296-ef83007cd0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:13.854900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fb72c-78e6-4831-a296-ef83007cd0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:13.855990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fb72c-78e6-4831-a296-ef83007cd0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:13.856307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fb72c-78e6-4831-a296-ef83007cd0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:13.858098 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fb72c-78e6-4831-a296-ef83007cd0c9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.871270 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 268/529] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:13.872175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fb72c-78e6-4831-a296-ef83007cd0c9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:13.950935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.955584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:13.966872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cae1f-c1c0-4398-95fd-85d2e9e5ad2f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:13.980215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fb72c-78e6-4831-a296-ef83007cd0c9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.012285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c8adb-5df5-4f2f-b6b3-b67660330d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.013325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c8adb-5df5-4f2f-b6b3-b67660330d3d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.013833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c8adb-5df5-4f2f-b6b3-b67660330d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.014182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c8adb-5df5-4f2f-b6b3-b67660330d3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.018637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d5d2a-eacb-4ebc-b1f9-5a4a9f254db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.020686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d5d2a-eacb-4ebc-b1f9-5a4a9f254db8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.021183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d5d2a-eacb-4ebc-b1f9-5a4a9f254db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.021709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d5d2a-eacb-4ebc-b1f9-5a4a9f254db8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.022310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c8adb-5df5-4f2f-b6b3-b67660330d3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.023785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c8adb-5df5-4f2f-b6b3-b67660330d3d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6c3c8adb-5df5-4f2f-b6b3-b67660330d3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:14.041365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:14.042258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:14.043078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:14.043078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:14.043078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:14.043078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:14.043078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:14.043078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:14.043078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:14.043078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:14.045805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 262/530] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:14.046980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c8adb-5df5-4f2f-b6b3-b67660330d3d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.108334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d5d2a-eacb-4ebc-b1f9-5a4a9f254db8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.110203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d5d2a-eacb-4ebc-b1f9-5a4a9f254db8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.176335 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c8adb-5df5-4f2f-b6b3-b67660330d3d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.206758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.215802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e543-2b51-4872-b142-1534b3a93f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.216923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e543-2b51-4872-b142-1534b3a93f07 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.217416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e543-2b51-4872-b142-1534b3a93f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.218106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043e543-2b51-4872-b142-1534b3a93f07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.225627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e543-2b51-4872-b142-1534b3a93f07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.227373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043e543-2b51-4872-b142-1534b3a93f07 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.238092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 269/531] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:14.239130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d5d2a-eacb-4ebc-b1f9-5a4a9f254db8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5043e543-2b51-4872-b142-1534b3a93f07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:14.247578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:14.248657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:14.249535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:14.249535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:14.249535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:14.249535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:14.249535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:14.249535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:14.249535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:14.249535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:14.252674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 263/532] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:14.254015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e543-2b51-4872-b142-1534b3a93f07 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.267789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.351522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d5d2a-eacb-4ebc-b1f9-5a4a9f254db8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.385111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043e543-2b51-4872-b142-1534b3a93f07 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.388823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6cef9-04e1-4f9c-97a0-22e7f05d737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.389768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6cef9-04e1-4f9c-97a0-22e7f05d737d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.390257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6cef9-04e1-4f9c-97a0-22e7f05d737d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.390767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6cef9-04e1-4f9c-97a0-22e7f05d737d None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.391744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6cef9-04e1-4f9c-97a0-22e7f05d737d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:14.392274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6cef9-04e1-4f9c-97a0-22e7f05d737d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.394233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6cef9-04e1-4f9c-97a0-22e7f05d737d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.412244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 270/533] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:14.413358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6cef9-04e1-4f9c-97a0-22e7f05d737d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.423376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb2ff1-ee83-462b-a8f3-f646ec679f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.424178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb2ff1-ee83-462b-a8f3-f646ec679f42 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.424465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb2ff1-ee83-462b-a8f3-f646ec679f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.424745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb2ff1-ee83-462b-a8f3-f646ec679f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.438055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb2ff1-ee83-462b-a8f3-f646ec679f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.441557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb2ff1-ee83-462b-a8f3-f646ec679f42 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.456758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1dcb2ff1-ee83-462b-a8f3-f646ec679f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:14.463310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:14.464198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:14.465143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:14.465143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:14.465143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:14.465143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:14.465143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 264/534] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:14.465396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb2ff1-ee83-462b-a8f3-f646ec679f42 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.527881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.548404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6cef9-04e1-4f9c-97a0-22e7f05d737d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.571440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb2ff1-ee83-462b-a8f3-f646ec679f42 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.595894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0929ffe-1dac-4219-b6c7-e906fab18f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.596733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0929ffe-1dac-4219-b6c7-e906fab18f8c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.597270 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0929ffe-1dac-4219-b6c7-e906fab18f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.597651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0929ffe-1dac-4219-b6c7-e906fab18f8c None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.598902 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0929ffe-1dac-4219-b6c7-e906fab18f8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:14.599585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0929ffe-1dac-4219-b6c7-e906fab18f8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.601294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0929ffe-1dac-4219-b6c7-e906fab18f8c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.614507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e127-d689-4aa8-98c1-c6c26ca04cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.615327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e127-d689-4aa8-98c1-c6c26ca04cdb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.615711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e127-d689-4aa8-98c1-c6c26ca04cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.616090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124e127-d689-4aa8-98c1-c6c26ca04cdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.616840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 271/535] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:14.617213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e127-d689-4aa8-98c1-c6c26ca04cdb None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=395e7e721bf349f2bee876a23fc12291) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:14.617511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e127-d689-4aa8-98c1-c6c26ca04cdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.618349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0929ffe-1dac-4219-b6c7-e906fab18f8c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.619389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b124e127-d689-4aa8-98c1-c6c26ca04cdb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.629752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 265/536] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/role_assignments?user.id=395e7e721bf349f2bee876a23fc12291&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:14.630888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e127-d689-4aa8-98c1-c6c26ca04cdb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:14.832358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124e127-d689-4aa8-98c1-c6c26ca04cdb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.849281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0929ffe-1dac-4219-b6c7-e906fab18f8c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:14.851059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.859287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:14.873225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e23bd-ec46-46ad-a014-2d61945f670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.874140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e23bd-ec46-46ad-a014-2d61945f670c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.874589 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e23bd-ec46-46ad-a014-2d61945f670c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.875528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e23bd-ec46-46ad-a014-2d61945f670c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.876520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e23bd-ec46-46ad-a014-2d61945f670c None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=079eeefcd0654dfe9cd4a9c51d239298) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:14.876979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e23bd-ec46-46ad-a014-2d61945f670c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.878773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e23bd-ec46-46ad-a014-2d61945f670c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.885966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 266/537] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/role_assignments?user.id=079eeefcd0654dfe9cd4a9c51d239298&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:14.894639 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef727232-dd25-45c3-b01b-55a30cab7445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:14.896625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef727232-dd25-45c3-b01b-55a30cab7445 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:14.896625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef727232-dd25-45c3-b01b-55a30cab7445 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:14.896625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef727232-dd25-45c3-b01b-55a30cab7445 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:14.896625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef727232-dd25-45c3-b01b-55a30cab7445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:14.896961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef727232-dd25-45c3-b01b-55a30cab7445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:14.901693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef727232-dd25-45c3-b01b-55a30cab7445 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:14.911607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 272/538] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:14.917373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e23bd-ec46-46ad-a014-2d61945f670c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.022288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e23bd-ec46-46ad-a014-2d61945f670c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.058279 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18754233-f2be-4eb4-8d91-c0d3124b14ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.059086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18754233-f2be-4eb4-8d91-c0d3124b14ea None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.059369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18754233-f2be-4eb4-8d91-c0d3124b14ea None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.059644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18754233-f2be-4eb4-8d91-c0d3124b14ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.073630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18754233-f2be-4eb4-8d91-c0d3124b14ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.075160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18754233-f2be-4eb4-8d91-c0d3124b14ea None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-18754233-f2be-4eb4-8d91-c0d3124b14ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:15.101027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:15.102118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:15.103132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:15.103132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:15.103132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:15.103132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:15.103132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:15.103132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:15.103132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:15.103132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:15.103132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 267/539] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:15.111057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef727232-dd25-45c3-b01b-55a30cab7445 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.219431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef727232-dd25-45c3-b01b-55a30cab7445 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.254840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ce06b-790c-40a4-81eb-e8c3384d97e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.255499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ce06b-790c-40a4-81eb-e8c3384d97e8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.255781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ce06b-790c-40a4-81eb-e8c3384d97e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.256057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ce06b-790c-40a4-81eb-e8c3384d97e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.256895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ce06b-790c-40a4-81eb-e8c3384d97e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:15.257210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ce06b-790c-40a4-81eb-e8c3384d97e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.258719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ce06b-790c-40a4-81eb-e8c3384d97e8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.270979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 273/540] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:15.276864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18754233-f2be-4eb4-8d91-c0d3124b14ea None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:15.348098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:15.402812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18754233-f2be-4eb4-8d91-c0d3124b14ea None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:15.445298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f991b-d747-4302-a86e-ef2b88a3db89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:15.445978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f991b-d747-4302-a86e-ef2b88a3db89 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.446264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f991b-d747-4302-a86e-ef2b88a3db89 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.446542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f991b-d747-4302-a86e-ef2b88a3db89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.447400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f991b-d747-4302-a86e-ef2b88a3db89 None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=d7a0dbcea7ef4cdd9134f4c5a9cf5fb5) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:15.447711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f991b-d747-4302-a86e-ef2b88a3db89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:15.449155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f991b-d747-4302-a86e-ef2b88a3db89 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:15.457941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 268/541] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/role_assignments?user.id=d7a0dbcea7ef4cdd9134f4c5a9cf5fb5&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:15.823132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b81e5-cd4f-44d5-a3a0-022396a7c41d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.823842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b81e5-cd4f-44d5-a3a0-022396a7c41d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.823842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b81e5-cd4f-44d5-a3a0-022396a7c41d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.825325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 274/542] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:15.831140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298623e-925e-446b-a980-5b0e81372cbf None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.831641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298623e-925e-446b-a980-5b0e81372cbf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.831791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298623e-925e-446b-a980-5b0e81372cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.850933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2298623e-925e-446b-a980-5b0e81372cbf None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:15.852137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2298623e-925e-446b-a980-5b0e81372cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:15.870664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed700-41e1-4f1f-a4c2-40a90db5faad None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.870970 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed700-41e1-4f1f-a4c2-40a90db5faad None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.871213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ed700-41e1-4f1f-a4c2-40a90db5faad None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.872850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 275/543] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:15.885477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2b8d2-9aed-4706-869e-31bfcb7ab487 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:15.885477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2b8d2-9aed-4706-869e-31bfcb7ab487 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:15.885477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2b8d2-9aed-4706-869e-31bfcb7ab487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:15.913507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d2b2b8d2-9aed-4706-869e-31bfcb7ab487 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:15.914729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d2b2b8d2-9aed-4706-869e-31bfcb7ab487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:15.935459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 269/544] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:15.943324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:15.972468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298623e-925e-446b-a980-5b0e81372cbf None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.050266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 276/545] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:16.050594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.074149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2b8d2-9aed-4706-869e-31bfcb7ab487 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.160970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298623e-925e-446b-a980-5b0e81372cbf None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.212259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb66990-fd37-43a9-bb55-accaa8a67e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.213383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb66990-fd37-43a9-bb55-accaa8a67e75 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.213694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb66990-fd37-43a9-bb55-accaa8a67e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.213994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb66990-fd37-43a9-bb55-accaa8a67e75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.226984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb66990-fd37-43a9-bb55-accaa8a67e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-3cb66990-fd37-43a9-bb55-accaa8a67e75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:16.236388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:16.237285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:16.238136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:16.242095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 270/546] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:16.243990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb66990-fd37-43a9-bb55-accaa8a67e75 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.271621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2b8d2-9aed-4706-869e-31bfcb7ab487 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.348002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75b985-f96d-4ba1-a0b3-890957330a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.349103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75b985-f96d-4ba1-a0b3-890957330a99 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.349689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75b985-f96d-4ba1-a0b3-890957330a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.350126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75b985-f96d-4ba1-a0b3-890957330a99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.363087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb66990-fd37-43a9-bb55-accaa8a67e75 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.364769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.375772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75b985-f96d-4ba1-a0b3-890957330a99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fb75b985-f96d-4ba1-a0b3-890957330a99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:16.384662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:16.385640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:16.386451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:16.394612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 277/547] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:16.398020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75b985-f96d-4ba1-a0b3-890957330a99 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.413746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.427205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e217354-4369-4bdb-a61e-2a0783ac1650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.436234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e217354-4369-4bdb-a61e-2a0783ac1650 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.436234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e217354-4369-4bdb-a61e-2a0783ac1650 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.436234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e217354-4369-4bdb-a61e-2a0783ac1650 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.436234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e217354-4369-4bdb-a61e-2a0783ac1650 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:16.436234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e217354-4369-4bdb-a61e-2a0783ac1650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.436234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e217354-4369-4bdb-a61e-2a0783ac1650 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.450639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 271/548] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:16.457685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e217354-4369-4bdb-a61e-2a0783ac1650 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.546452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75b985-f96d-4ba1-a0b3-890957330a99 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.582660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6acac-d245-408e-997f-6ca4ade42df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.583327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6acac-d245-408e-997f-6ca4ade42df8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.583612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6acac-d245-408e-997f-6ca4ade42df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.583889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6acac-d245-408e-997f-6ca4ade42df8 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.584626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6acac-d245-408e-997f-6ca4ade42df8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:16.584933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6acac-d245-408e-997f-6ca4ade42df8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.586335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6acac-d245-408e-997f-6ca4ade42df8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.595036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 278/549] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:16.600695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6acac-d245-408e-997f-6ca4ade42df8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.658160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e217354-4369-4bdb-a61e-2a0783ac1650 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.721995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7dbe1-3c01-4fa7-9c68-658a5c76d2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.722786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7dbe1-3c01-4fa7-9c68-658a5c76d2ba None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.723071 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7dbe1-3c01-4fa7-9c68-658a5c76d2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.723347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7dbe1-3c01-4fa7-9c68-658a5c76d2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.735955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.751448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7dbe1-3c01-4fa7-9c68-658a5c76d2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.752916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7dbe1-3c01-4fa7-9c68-658a5c76d2ba None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-80d7dbe1-3c01-4fa7-9c68-658a5c76d2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:16.792708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:16.793645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:16.794519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:16.794519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:16.794519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:16.794519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:16.801843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 272/550] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:16.803285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6acac-d245-408e-997f-6ca4ade42df8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:16.816606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7dbe1-3c01-4fa7-9c68-658a5c76d2ba None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.841470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.867770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a492b7-6bf0-4587-8454-408d1fe72556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:16.868577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a492b7-6bf0-4587-8454-408d1fe72556 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.868858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a492b7-6bf0-4587-8454-408d1fe72556 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.869149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a492b7-6bf0-4587-8454-408d1fe72556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.891455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a492b7-6bf0-4587-8454-408d1fe72556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:16.893254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a492b7-6bf0-4587-8454-408d1fe72556 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-97a492b7-6bf0-4587-8454-408d1fe72556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:16.921237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:16.922265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:16.923101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:16.923101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:16.923101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:16.923101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:16.929405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 279/551] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:16.935164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a492b7-6bf0-4587-8454-408d1fe72556 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:16.984930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7dbe1-3c01-4fa7-9c68-658a5c76d2ba None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.052280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077872a-f84a-45e6-937c-c02900b65c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.052962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077872a-f84a-45e6-937c-c02900b65c54 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.053247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077872a-f84a-45e6-937c-c02900b65c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.053528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077872a-f84a-45e6-937c-c02900b65c54 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.054302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077872a-f84a-45e6-937c-c02900b65c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.054613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077872a-f84a-45e6-937c-c02900b65c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.056006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077872a-f84a-45e6-937c-c02900b65c54 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.090309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 273/552] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:17.106178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077872a-f84a-45e6-937c-c02900b65c54 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.138727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a492b7-6bf0-4587-8454-408d1fe72556 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.179028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.207718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2b3fb-3b2a-46db-93e7-bd7e9d197238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.208387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2b3fb-3b2a-46db-93e7-bd7e9d197238 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.208724 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2b3fb-3b2a-46db-93e7-bd7e9d197238 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.208936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2b3fb-3b2a-46db-93e7-bd7e9d197238 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.209659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2b3fb-3b2a-46db-93e7-bd7e9d197238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.210194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2b3fb-3b2a-46db-93e7-bd7e9d197238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.212665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d2b3fb-3b2a-46db-93e7-bd7e9d197238 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.225852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 280/553] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.238844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2b3fb-3b2a-46db-93e7-bd7e9d197238 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.244456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.257313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077872a-f84a-45e6-937c-c02900b65c54 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.333805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbcc0e-5838-488b-b4e6-e709eb8b1222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.334622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbcc0e-5838-488b-b4e6-e709eb8b1222 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.334914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbcc0e-5838-488b-b4e6-e709eb8b1222 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.335204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbcc0e-5838-488b-b4e6-e709eb8b1222 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.347070 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbcc0e-5838-488b-b4e6-e709eb8b1222 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.348554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbcc0e-5838-488b-b4e6-e709eb8b1222 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-14cbcc0e-5838-488b-b4e6-e709eb8b1222 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:17.383701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:17.384675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:17.385574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 274/554] 10.222.0.41 () {56 vars in 1093 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:17.393538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbcc0e-5838-488b-b4e6-e709eb8b1222 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.404377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2b3fb-3b2a-46db-93e7-bd7e9d197238 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.447330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d050c-3f4a-4248-bb7c-dece185c2669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.448190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d050c-3f4a-4248-bb7c-dece185c2669 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.448483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d050c-3f4a-4248-bb7c-dece185c2669 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.448765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d050c-3f4a-4248-bb7c-dece185c2669 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.457872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d050c-3f4a-4248-bb7c-dece185c2669 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.459435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d050c-3f4a-4248-bb7c-dece185c2669 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f35d050c-3f4a-4248-bb7c-dece185c2669 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:17.476131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:17.478026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:17.479671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 281/555] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:17.486426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d050c-3f4a-4248-bb7c-dece185c2669 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.532866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.569713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbcc0e-5838-488b-b4e6-e709eb8b1222 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.607547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d050c-3f4a-4248-bb7c-dece185c2669 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.609018 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e0fe9-fa42-48d9-b238-49661c0d5a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.610622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0fe9-fa42-48d9-b238-49661c0d5a0b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.611132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0fe9-fa42-48d9-b238-49661c0d5a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.611611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e0fe9-fa42-48d9-b238-49661c0d5a0b None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.612751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e0fe9-fa42-48d9-b238-49661c0d5a0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.613281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e0fe9-fa42-48d9-b238-49661c0d5a0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.614986 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51e0fe9-fa42-48d9-b238-49661c0d5a0b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.618998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.638184 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 275/556] 10.222.0.41 () {56 vars in 1133 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.640576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb131be-5e76-464a-95f7-1fd028645bca None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.641270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb131be-5e76-464a-95f7-1fd028645bca None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.641649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb131be-5e76-464a-95f7-1fd028645bca None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.649348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 276/557] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:17.649348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ec6ad-6828-4118-a544-706324f41f6a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.649348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ec6ad-6828-4118-a544-706324f41f6a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.649348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282ec6ad-6828-4118-a544-706324f41f6a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.650736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9434c-a57f-49a9-9b57-05ededf794ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.650863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 277/558] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:17.651506 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ec6ad-6828-4118-a544-706324f41f6a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.651833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9434c-a57f-49a9-9b57-05ededf794ab None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.652276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9434c-a57f-49a9-9b57-05ededf794ab None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.652700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9434c-a57f-49a9-9b57-05ededf794ab None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.653711 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9434c-a57f-49a9-9b57-05ededf794ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.654369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9434c-a57f-49a9-9b57-05ededf794ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.657061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9434c-a57f-49a9-9b57-05ededf794ab None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.700342 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 282/559] 10.222.0.41 () {56 vars in 1135 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:17.701924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2304d-9ccb-45ab-8ef3-c1fced71a17a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.702214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2304d-9ccb-45ab-8ef3-c1fced71a17a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.702497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2304d-9ccb-45ab-8ef3-c1fced71a17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.719644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a4d2304d-9ccb-45ab-8ef3-c1fced71a17a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:17.720844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a4d2304d-9ccb-45ab-8ef3-c1fced71a17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:17.795280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 283/560] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:17.796386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bc0ef-1e5b-42fe-a4bb-a52f38eb2df1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.797237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bc0ef-1e5b-42fe-a4bb-a52f38eb2df1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.797517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bc0ef-1e5b-42fe-a4bb-a52f38eb2df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.809771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282ec6ad-6828-4118-a544-706324f41f6a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.814193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a96bc0ef-1e5b-42fe-a4bb-a52f38eb2df1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:17.815384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a96bc0ef-1e5b-42fe-a4bb-a52f38eb2df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:17.840409 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.848050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb3e7f-d04f-4ed1-8e8b-0b062b349363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.850683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb3e7f-d04f-4ed1-8e8b-0b062b349363 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.850683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb3e7f-d04f-4ed1-8e8b-0b062b349363 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.850683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb3e7f-d04f-4ed1-8e8b-0b062b349363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.860288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb3e7f-d04f-4ed1-8e8b-0b062b349363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.862195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb3e7f-d04f-4ed1-8e8b-0b062b349363 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ecbb3e7f-d04f-4ed1-8e8b-0b062b349363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:17.880127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:17.881042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:17.881955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:17.881955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:17.881955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:17.881955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:17.881955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 278/561] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:17.882217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb3e7f-d04f-4ed1-8e8b-0b062b349363 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.895867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 284/562] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:17.896638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bc0ef-1e5b-42fe-a4bb-a52f38eb2df1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.947945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.004275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb3e7f-d04f-4ed1-8e8b-0b062b349363 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.010089 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bc0ef-1e5b-42fe-a4bb-a52f38eb2df1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.040976 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332158e6-f75c-4086-9fae-1423faf435cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.041577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332158e6-f75c-4086-9fae-1423faf435cd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.041928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332158e6-f75c-4086-9fae-1423faf435cd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.042215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332158e6-f75c-4086-9fae-1423faf435cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.049128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504553e2-fe84-4f23-bc01-6fd6927dbbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.049998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504553e2-fe84-4f23-bc01-6fd6927dbbcb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.050318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504553e2-fe84-4f23-bc01-6fd6927dbbcb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.050599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504553e2-fe84-4f23-bc01-6fd6927dbbcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.061981 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504553e2-fe84-4f23-bc01-6fd6927dbbcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-504553e2-fe84-4f23-bc01-6fd6927dbbcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:18.069779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:18.070746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:18.071566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 285/563] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:18.072255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504553e2-fe84-4f23-bc01-6fd6927dbbcb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.102377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.123392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332158e6-f75c-4086-9fae-1423faf435cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.124961 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332158e6-f75c-4086-9fae-1423faf435cd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.170790 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.180876 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504553e2-fe84-4f23-bc01-6fd6927dbbcb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.214417 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8a19c-f4be-41ab-af0e-71b49b98001d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.215004 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8a19c-f4be-41ab-af0e-71b49b98001d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.215290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8a19c-f4be-41ab-af0e-71b49b98001d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.215569 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8a19c-f4be-41ab-af0e-71b49b98001d None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.216287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8a19c-f4be-41ab-af0e-71b49b98001d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:18.216596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8a19c-f4be-41ab-af0e-71b49b98001d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.218007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8a19c-f4be-41ab-af0e-71b49b98001d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.224057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 279/564] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:18.224938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332158e6-f75c-4086-9fae-1423faf435cd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.233730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 286/565] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.234538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8a19c-f4be-41ab-af0e-71b49b98001d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.311647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.320576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332158e6-f75c-4086-9fae-1423faf435cd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.333474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8a19c-f4be-41ab-af0e-71b49b98001d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.354339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8ae6-bc58-4300-bc39-f58f465b7902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.355127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8ae6-bc58-4300-bc39-f58f465b7902 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.355408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8ae6-bc58-4300-bc39-f58f465b7902 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.355709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8ae6-bc58-4300-bc39-f58f465b7902 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.365502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b8ae6-bc58-4300-bc39-f58f465b7902 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:18.366756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b54ffe-7971-4535-863b-2d793c232b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.367421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b54ffe-7971-4535-863b-2d793c232b18 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.367713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b54ffe-7971-4535-863b-2d793c232b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.367995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b54ffe-7971-4535-863b-2d793c232b18 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.368737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b54ffe-7971-4535-863b-2d793c232b18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:18.369046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b54ffe-7971-4535-863b-2d793c232b18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.370698 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b54ffe-7971-4535-863b-2d793c232b18 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ef7b8ae6-bc58-4300-bc39-f58f465b7902 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:18.373313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:18.374240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:18.375566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 280/566] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:18.376562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6028c-565c-42ce-a491-f92d1d98f99d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.376562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6028c-565c-42ce-a491-f92d1d98f99d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.376812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6028c-565c-42ce-a491-f92d1d98f99d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.378082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 281/567] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:18.378748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6028c-565c-42ce-a491-f92d1d98f99d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.383225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 287/568] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.384261 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b54ffe-7971-4535-863b-2d793c232b18 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.388327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.479458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6028c-565c-42ce-a491-f92d1d98f99d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.483663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b54ffe-7971-4535-863b-2d793c232b18 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.512595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5d4ca-b66c-425e-aa1a-8027452aefbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.513380 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5d4ca-b66c-425e-aa1a-8027452aefbc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.513674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5d4ca-b66c-425e-aa1a-8027452aefbc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.513980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5d4ca-b66c-425e-aa1a-8027452aefbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.517378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac90c8-32e9-4744-9b40-04929949a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.518200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac90c8-32e9-4744-9b40-04929949a202 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.518488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac90c8-32e9-4744-9b40-04929949a202 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.518860 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac90c8-32e9-4744-9b40-04929949a202 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.525072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5d4ca-b66c-425e-aa1a-8027452aefbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.525809 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac90c8-32e9-4744-9b40-04929949a202 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.526556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5d4ca-b66c-425e-aa1a-8027452aefbc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.527245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac90c8-32e9-4744-9b40-04929949a202 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.529767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a1ac90c8-32e9-4744-9b40-04929949a202 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:18.542256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:18.543165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:18.544047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:18.544047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:18.544047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:18.544047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:18.544047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:18.544047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:18.544047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:18.544047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:18.544047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 288/569] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-46f5d4ca-b66c-425e-aa1a-8027452aefbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:18.544540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:18.545316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:18.547195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:18.547195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:18.547195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:18.547195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:18.547584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac90c8-32e9-4744-9b40-04929949a202 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.547693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 282/570] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:18.547693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13887c-e598-45c8-acbf-c4ae38f9e27c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.547693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13887c-e598-45c8-acbf-c4ae38f9e27c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.547693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13887c-e598-45c8-acbf-c4ae38f9e27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.563735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-dd13887c-e598-45c8-acbf-c4ae38f9e27c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:18.564920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dd13887c-e598-45c8-acbf-c4ae38f9e27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:18.617096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.630915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 283/571] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:18.631855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13887c-e598-45c8-acbf-c4ae38f9e27c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.654512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac90c8-32e9-4744-9b40-04929949a202 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.688701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106436-a642-4c41-9611-7cb911f3fac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.689362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106436-a642-4c41-9611-7cb911f3fac0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.689648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106436-a642-4c41-9611-7cb911f3fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.689957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c106436-a642-4c41-9611-7cb911f3fac0 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.690698 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c106436-a642-4c41-9611-7cb911f3fac0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:18.691001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c106436-a642-4c41-9611-7cb911f3fac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.692366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c106436-a642-4c41-9611-7cb911f3fac0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.700279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 289/572] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.701052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106436-a642-4c41-9611-7cb911f3fac0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.729154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13887c-e598-45c8-acbf-c4ae38f9e27c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.763497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b19d0-811b-4efc-87f7-a430658e4935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.764225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b19d0-811b-4efc-87f7-a430658e4935 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.764515 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b19d0-811b-4efc-87f7-a430658e4935 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.764823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b19d0-811b-4efc-87f7-a430658e4935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.765657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.774887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b19d0-811b-4efc-87f7-a430658e4935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.776341 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b19d0-811b-4efc-87f7-a430658e4935 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-556b19d0-811b-4efc-87f7-a430658e4935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:18.793853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:18.794739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:18.795575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:18.795575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:18.795575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:18.795575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:18.795575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 284/573] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:18.795855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b19d0-811b-4efc-87f7-a430658e4935 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.811790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c106436-a642-4c41-9611-7cb911f3fac0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.845101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df88af3-3c26-4140-b52d-0d5c6d9ec7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.845801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df88af3-3c26-4140-b52d-0d5c6d9ec7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.846097 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df88af3-3c26-4140-b52d-0d5c6d9ec7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.846208 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.846381 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df88af3-3c26-4140-b52d-0d5c6d9ec7c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.847251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df88af3-3c26-4140-b52d-0d5c6d9ec7c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:18.847570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df88af3-3c26-4140-b52d-0d5c6d9ec7c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.849007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df88af3-3c26-4140-b52d-0d5c6d9ec7c4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.862637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 290/574] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.863416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df88af3-3c26-4140-b52d-0d5c6d9ec7c4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.905778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b19d0-811b-4efc-87f7-a430658e4935 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.940954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c4331-1115-4cf2-92aa-e62f948de9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.941730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4331-1115-4cf2-92aa-e62f948de9fc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.942018 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4331-1115-4cf2-92aa-e62f948de9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.942297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c4331-1115-4cf2-92aa-e62f948de9fc None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.943020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c4331-1115-4cf2-92aa-e62f948de9fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:18.943605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c4331-1115-4cf2-92aa-e62f948de9fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.944701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194c4331-1115-4cf2-92aa-e62f948de9fc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.955785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 285/575] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.956568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c4331-1115-4cf2-92aa-e62f948de9fc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.963744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df88af3-3c26-4140-b52d-0d5c6d9ec7c4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.986851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.998382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f260e9-8d8c-4cd8-8d12-d2863041634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.999179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f260e9-8d8c-4cd8-8d12-d2863041634e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.999469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f260e9-8d8c-4cd8-8d12-d2863041634e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.000294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f260e9-8d8c-4cd8-8d12-d2863041634e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.011113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f260e9-8d8c-4cd8-8d12-d2863041634e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-44f260e9-8d8c-4cd8-8d12-d2863041634e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:19.019274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:19.020216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:19.021056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 291/576] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:19.021768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f260e9-8d8c-4cd8-8d12-d2863041634e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.057503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.060525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194c4331-1115-4cf2-92aa-e62f948de9fc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.097170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e9ea-98e7-4769-91a3-f50de647d137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.097997 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e9ea-98e7-4769-91a3-f50de647d137 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.098278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e9ea-98e7-4769-91a3-f50de647d137 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.098551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e9ea-98e7-4769-91a3-f50de647d137 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.108822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300e9ea-98e7-4769-91a3-f50de647d137 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.110843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300e9ea-98e7-4769-91a3-f50de647d137 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.121944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f260e9-8d8c-4cd8-8d12-d2863041634e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e300e9ea-98e7-4769-91a3-f50de647d137 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:19.127485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:19.128579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:19.129464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:19.129464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:19.129464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:19.129464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:19.129464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 286/577] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:19.129464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e9ea-98e7-4769-91a3-f50de647d137 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.159708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0a74-a8e6-48b3-9210-22c1b3056091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.160346 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0a74-a8e6-48b3-9210-22c1b3056091 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.160628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0a74-a8e6-48b3-9210-22c1b3056091 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.160903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0a74-a8e6-48b3-9210-22c1b3056091 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.161615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b0a74-a8e6-48b3-9210-22c1b3056091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:19.161955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b0a74-a8e6-48b3-9210-22c1b3056091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.163317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b0a74-a8e6-48b3-9210-22c1b3056091 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.175424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 292/578] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:19.176201 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0a74-a8e6-48b3-9210-22c1b3056091 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.216971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.227837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e9ea-98e7-4769-91a3-f50de647d137 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.262396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71253b9d-23f5-4ff8-8b43-c6cf52f85623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.263278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71253b9d-23f5-4ff8-8b43-c6cf52f85623 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.263561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71253b9d-23f5-4ff8-8b43-c6cf52f85623 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.263838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71253b9d-23f5-4ff8-8b43-c6cf52f85623 None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/a1e4a66515654e1f9f7452740ff4ce58/roles/87a7ef7c55854edb887513f9e471440c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.272325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0a74-a8e6-48b3-9210-22c1b3056091 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.277728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71253b9d-23f5-4ff8-8b43-c6cf52f85623 None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=a1e4a66515654e1f9f7452740ff4ce58, role_id=87a7ef7c55854edb887513f9e471440c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.279162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71253b9d-23f5-4ff8-8b43-c6cf52f85623 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.306524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b005-b180-487e-8d5e-39012465d7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.307311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b005-b180-487e-8d5e-39012465d7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.307601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b005-b180-487e-8d5e-39012465d7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.307884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16b005-b180-487e-8d5e-39012465d7c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.314386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16b005-b180-487e-8d5e-39012465d7c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.315874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16b005-b180-487e-8d5e-39012465d7c7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-3e16b005-b180-487e-8d5e-39012465d7c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:19.329312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:19.330329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:19.331272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:19.331272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:19.331272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:19.331272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:19.331272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:19.331272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:19.331272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:19.331272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:19.331272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 293/579] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:19.332050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b005-b180-487e-8d5e-39012465d7c7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.358363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 287/580] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:24:19 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/a1e4a66515654e1f9f7452740ff4ce58/roles/87a7ef7c55854edb887513f9e471440c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:19.359791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71253b9d-23f5-4ff8-8b43-c6cf52f85623 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.362382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.458636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16b005-b180-487e-8d5e-39012465d7c7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.460600 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.477596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71253b9d-23f5-4ff8-8b43-c6cf52f85623 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.497830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea852af-60ea-4dd8-91d1-ba56318f2fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.498792 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea852af-60ea-4dd8-91d1-ba56318f2fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.499228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea852af-60ea-4dd8-91d1-ba56318f2fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.499718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea852af-60ea-4dd8-91d1-ba56318f2fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.501175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea852af-60ea-4dd8-91d1-ba56318f2fd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:19.501659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea852af-60ea-4dd8-91d1-ba56318f2fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.503341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea852af-60ea-4dd8-91d1-ba56318f2fd2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.513194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 294/581] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:19.514334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea852af-60ea-4dd8-91d1-ba56318f2fd2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.518561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58973354-fc1d-41c9-8b8a-259687200670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.519264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58973354-fc1d-41c9-8b8a-259687200670 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.519896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58973354-fc1d-41c9-8b8a-259687200670 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.520180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58973354-fc1d-41c9-8b8a-259687200670 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.521914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58973354-fc1d-41c9-8b8a-259687200670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:19.522239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58973354-fc1d-41c9-8b8a-259687200670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.523723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58973354-fc1d-41c9-8b8a-259687200670 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.541698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 288/582] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:19.541698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58973354-fc1d-41c9-8b8a-259687200670 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.613393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.630494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea852af-60ea-4dd8-91d1-ba56318f2fd2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.653770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58973354-fc1d-41c9-8b8a-259687200670 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.665275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ebd0-2506-47e2-a725-297acc248148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.666100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ebd0-2506-47e2-a725-297acc248148 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.666383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ebd0-2506-47e2-a725-297acc248148 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.666658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0ebd0-2506-47e2-a725-297acc248148 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.675678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0ebd0-2506-47e2-a725-297acc248148 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.677124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0ebd0-2506-47e2-a725-297acc248148 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.690324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb586e8-8136-40b6-8270-c7518ae6d8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.691077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb586e8-8136-40b6-8270-c7518ae6d8ad None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.691428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb586e8-8136-40b6-8270-c7518ae6d8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.691712 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb586e8-8136-40b6-8270-c7518ae6d8ad None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-abb0ebd0-2506-47e2-a725-297acc248148 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:19.692103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:19.693002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:19.694301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:19.694301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:19.694301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:19.694301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:19.694301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:19.694301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:19.694301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:19.694301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:19.694301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:19.694301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:19.694816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb586e8-8136-40b6-8270-c7518ae6d8ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:19.694816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb586e8-8136-40b6-8270-c7518ae6d8ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.694816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb586e8-8136-40b6-8270-c7518ae6d8ad None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.697975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 295/583] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:19.698822 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ebd0-2506-47e2-a725-297acc248148 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.717963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 289/584] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:19.717963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb586e8-8136-40b6-8270-c7518ae6d8ad None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.729407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.807311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0ebd0-2506-47e2-a725-297acc248148 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.824598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb586e8-8136-40b6-8270-c7518ae6d8ad None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.844057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6482c2-0739-4e39-9ca5-a0ff45c0379d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.844846 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6482c2-0739-4e39-9ca5-a0ff45c0379d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.845130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6482c2-0739-4e39-9ca5-a0ff45c0379d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.845408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6482c2-0739-4e39-9ca5-a0ff45c0379d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.848953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.858098 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6482c2-0739-4e39-9ca5-a0ff45c0379d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.859813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6482c2-0739-4e39-9ca5-a0ff45c0379d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.862528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adb7ed-02e5-4c37-8367-1194a1a2a249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.863292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adb7ed-02e5-4c37-8367-1194a1a2a249 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.863577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adb7ed-02e5-4c37-8367-1194a1a2a249 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.863855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adb7ed-02e5-4c37-8367-1194a1a2a249 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.871663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adb7ed-02e5-4c37-8367-1194a1a2a249 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.873110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adb7ed-02e5-4c37-8367-1194a1a2a249 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2c6482c2-0739-4e39-9ca5-a0ff45c0379d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:19.879504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:19.880330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:19.881195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:19.881195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:19.881195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:19.881195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:19.881195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 296/585] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:19.881469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6482c2-0739-4e39-9ca5-a0ff45c0379d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b3adb7ed-02e5-4c37-8367-1194a1a2a249 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:19.893267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:19.894234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:19.895143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 290/586] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:19.895716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adb7ed-02e5-4c37-8367-1194a1a2a249 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.967623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.989409 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6482c2-0739-4e39-9ca5-a0ff45c0379d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.001060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adb7ed-02e5-4c37-8367-1194a1a2a249 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.025075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f19e2-b987-4ea2-bc12-ceedab3ccd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.025782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f19e2-b987-4ea2-bc12-ceedab3ccd95 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.026073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f19e2-b987-4ea2-bc12-ceedab3ccd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.026356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7f19e2-b987-4ea2-bc12-ceedab3ccd95 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.027194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f19e2-b987-4ea2-bc12-ceedab3ccd95 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:20.027500 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f19e2-b987-4ea2-bc12-ceedab3ccd95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.028931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7f19e2-b987-4ea2-bc12-ceedab3ccd95 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.040309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d00a1e-85f3-4f7f-b929-32a439229139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.041272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d00a1e-85f3-4f7f-b929-32a439229139 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.041799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d00a1e-85f3-4f7f-b929-32a439229139 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.042279 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d00a1e-85f3-4f7f-b929-32a439229139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.043428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d00a1e-85f3-4f7f-b929-32a439229139 None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=af5ebb39734144418fe35f9f0a679145) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:20.043963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d00a1e-85f3-4f7f-b929-32a439229139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.045710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d00a1e-85f3-4f7f-b929-32a439229139 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.046516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 297/587] 10.222.0.41 () {56 vars in 1137 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:20.047638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f19e2-b987-4ea2-bc12-ceedab3ccd95 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.061799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 291/588] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/role_assignments?user.id=af5ebb39734144418fe35f9f0a679145&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:20.061799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d00a1e-85f3-4f7f-b929-32a439229139 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.113821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.171807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7f19e2-b987-4ea2-bc12-ceedab3ccd95 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.175660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d00a1e-85f3-4f7f-b929-32a439229139 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.211379 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0acb0b-7a98-4d13-9d75-53caeec36006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.212061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0acb0b-7a98-4d13-9d75-53caeec36006 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.212347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0acb0b-7a98-4d13-9d75-53caeec36006 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.212628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0acb0b-7a98-4d13-9d75-53caeec36006 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.213467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0acb0b-7a98-4d13-9d75-53caeec36006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:20.213927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0acb0b-7a98-4d13-9d75-53caeec36006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.214778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef245d-3b91-40c4-a719-ac0aace64ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.215323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0acb0b-7a98-4d13-9d75-53caeec36006 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.215492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef245d-3b91-40c4-a719-ac0aace64ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.215750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef245d-3b91-40c4-a719-ac0aace64ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.216027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef245d-3b91-40c4-a719-ac0aace64ce6 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.217025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.218078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef245d-3b91-40c4-a719-ac0aace64ce6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:20.218639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef245d-3b91-40c4-a719-ac0aace64ce6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.220254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef245d-3b91-40c4-a719-ac0aace64ce6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.233842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 298/589] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:20.235393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0acb0b-7a98-4d13-9d75-53caeec36006 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.246368 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 292/590] 10.222.0.41 () {56 vars in 1137 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:20.247590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef245d-3b91-40c4-a719-ac0aace64ce6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.358179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef245d-3b91-40c4-a719-ac0aace64ce6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.362049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.364909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0acb0b-7a98-4d13-9d75-53caeec36006 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.402734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18a8b7-ba52-4569-b136-042cf985613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.403544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18a8b7-ba52-4569-b136-042cf985613d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.403815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18a8b7-ba52-4569-b136-042cf985613d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.404153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18a8b7-ba52-4569-b136-042cf985613d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.408346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b989-21e9-40a8-858f-1073631c3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.409384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b989-21e9-40a8-858f-1073631c3eba None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.409981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b989-21e9-40a8-858f-1073631c3eba None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.410480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33b989-21e9-40a8-858f-1073631c3eba None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.415920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18a8b7-ba52-4569-b136-042cf985613d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.417447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18a8b7-ba52-4569-b136-042cf985613d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.420950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33b989-21e9-40a8-858f-1073631c3eba None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.423204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33b989-21e9-40a8-858f-1073631c3eba None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ec18a8b7-ba52-4569-b136-042cf985613d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:20.436027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:20.436928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:20.437903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:20.437903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:20.437903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:20.437903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:20.441779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 299/591] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7a33b989-21e9-40a8-858f-1073631c3eba None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:20.442273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:20.443146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:20.444032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:20.444032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:20.444032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:20.444032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:20.444032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:20.444032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:20.444032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:20.444032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:20.444032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:20.444032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:20.444551 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18a8b7-ba52-4569-b136-042cf985613d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.452155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 293/592] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:20.453943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b989-21e9-40a8-858f-1073631c3eba None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.500616 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.556858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18a8b7-ba52-4569-b136-042cf985613d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.592844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19492d0b-3b43-45b1-9ff9-b32b6d2f549d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.594200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19492d0b-3b43-45b1-9ff9-b32b6d2f549d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.594553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19492d0b-3b43-45b1-9ff9-b32b6d2f549d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.594744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19492d0b-3b43-45b1-9ff9-b32b6d2f549d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.597845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33b989-21e9-40a8-858f-1073631c3eba None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.611263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19492d0b-3b43-45b1-9ff9-b32b6d2f549d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.614044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19492d0b-3b43-45b1-9ff9-b32b6d2f549d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.634482 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f66ed-e9ec-45d3-80dc-d2c9d2ed3976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.635148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f66ed-e9ec-45d3-80dc-d2c9d2ed3976 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.635471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f66ed-e9ec-45d3-80dc-d2c9d2ed3976 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.635804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6f66ed-e9ec-45d3-80dc-d2c9d2ed3976 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.636615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f66ed-e9ec-45d3-80dc-d2c9d2ed3976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:20.636920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f66ed-e9ec-45d3-80dc-d2c9d2ed3976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.638420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6f66ed-e9ec-45d3-80dc-d2c9d2ed3976 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-19492d0b-3b43-45b1-9ff9-b32b6d2f549d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:20.639352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:20.640239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:20.641140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:20.641140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:20.641140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:20.641140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:20.644001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 300/593] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:20.644954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19492d0b-3b43-45b1-9ff9-b32b6d2f549d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.660513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 294/594] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:20.661503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f66ed-e9ec-45d3-80dc-d2c9d2ed3976 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.687578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.772996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6f66ed-e9ec-45d3-80dc-d2c9d2ed3976 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.774105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.778352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19492d0b-3b43-45b1-9ff9-b32b6d2f549d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.819300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f5a4d-5b94-487d-bcd5-ea7ad303e4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.819995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429031c5-dafd-4623-bd82-cf2020c49323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.820512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5a4d-5b94-487d-bcd5-ea7ad303e4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.820960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5a4d-5b94-487d-bcd5-ea7ad303e4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.821398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5a4d-5b94-487d-bcd5-ea7ad303e4e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.821819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429031c5-dafd-4623-bd82-cf2020c49323 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.822211 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429031c5-dafd-4623-bd82-cf2020c49323 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.822622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f5a4d-5b94-487d-bcd5-ea7ad303e4e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:20.822932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429031c5-dafd-4623-bd82-cf2020c49323 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.823243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f5a4d-5b94-487d-bcd5-ea7ad303e4e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.823978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429031c5-dafd-4623-bd82-cf2020c49323 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:20.824388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429031c5-dafd-4623-bd82-cf2020c49323 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.825098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f5a4d-5b94-487d-bcd5-ea7ad303e4e8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.826026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429031c5-dafd-4623-bd82-cf2020c49323 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.844170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 295/595] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:20.845234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f5a4d-5b94-487d-bcd5-ea7ad303e4e8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 301/596] 10.222.0.41 () {56 vars in 1139 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:20.862888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429031c5-dafd-4623-bd82-cf2020c49323 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.961219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.965163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429031c5-dafd-4623-bd82-cf2020c49323 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.980762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f5a4d-5b94-487d-bcd5-ea7ad303e4e8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.002167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e356d9-1420-4b0d-86bf-c421d0a0bf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.003698 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e356d9-1420-4b0d-86bf-c421d0a0bf38 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.004646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e356d9-1420-4b0d-86bf-c421d0a0bf38 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.005023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e356d9-1420-4b0d-86bf-c421d0a0bf38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.012670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e356d9-1420-4b0d-86bf-c421d0a0bf38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.014327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e356d9-1420-4b0d-86bf-c421d0a0bf38 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.025087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85532878-3cbc-4f44-a305-e6d68caab830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.026474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85532878-3cbc-4f44-a305-e6d68caab830 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.026899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85532878-3cbc-4f44-a305-e6d68caab830 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.027336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85532878-3cbc-4f44-a305-e6d68caab830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-78e356d9-1420-4b0d-86bf-c421d0a0bf38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:21.031123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:21.032210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:21.033286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:21.033286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:21.033286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:21.033286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:21.033286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:21.033286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:21.033286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:21.033286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:21.037407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85532878-3cbc-4f44-a305-e6d68caab830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.039196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85532878-3cbc-4f44-a305-e6d68caab830 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.039419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 302/597] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:21.040361 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e356d9-1420-4b0d-86bf-c421d0a0bf38 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-85532878-3cbc-4f44-a305-e6d68caab830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:21.056125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:21.057228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:21.058324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:21.058324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:21.058324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:21.058324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:21.058324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:21.058324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:21.058324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:21.058324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:21.064467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.064838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 296/598] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:21.066392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85532878-3cbc-4f44-a305-e6d68caab830 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.157102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e356d9-1420-4b0d-86bf-c421d0a0bf38 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.191867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85532878-3cbc-4f44-a305-e6d68caab830 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.194344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea679306-25eb-43fb-bb6f-4c17a24b4c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.195624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea679306-25eb-43fb-bb6f-4c17a24b4c9c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.195624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea679306-25eb-43fb-bb6f-4c17a24b4c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.196066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea679306-25eb-43fb-bb6f-4c17a24b4c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.208177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea679306-25eb-43fb-bb6f-4c17a24b4c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.210462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea679306-25eb-43fb-bb6f-4c17a24b4c9c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ea679306-25eb-43fb-bb6f-4c17a24b4c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:21.230432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:21.231566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:21.232650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:21.232650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:21.232650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:21.232650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:21.238966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 303/599] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:21.238966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea679306-25eb-43fb-bb6f-4c17a24b4c9c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.241900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10520f-66ee-4465-bb4c-a108ee0850d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.243673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10520f-66ee-4465-bb4c-a108ee0850d4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.244113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10520f-66ee-4465-bb4c-a108ee0850d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.244542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10520f-66ee-4465-bb4c-a108ee0850d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.245775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10520f-66ee-4465-bb4c-a108ee0850d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:21.246233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10520f-66ee-4465-bb4c-a108ee0850d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.247848 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10520f-66ee-4465-bb4c-a108ee0850d4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.263187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 297/600] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.264746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10520f-66ee-4465-bb4c-a108ee0850d4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.270003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.319225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.358702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea679306-25eb-43fb-bb6f-4c17a24b4c9c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.395849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad25d0-43c9-4a26-99af-865d39167eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.396939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad25d0-43c9-4a26-99af-865d39167eaf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.397048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10520f-66ee-4465-bb4c-a108ee0850d4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.397603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad25d0-43c9-4a26-99af-865d39167eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.398130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad25d0-43c9-4a26-99af-865d39167eaf None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.399207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad25d0-43c9-4a26-99af-865d39167eaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:21.399741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad25d0-43c9-4a26-99af-865d39167eaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.401457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad25d0-43c9-4a26-99af-865d39167eaf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.420909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 304/601] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.422298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad25d0-43c9-4a26-99af-865d39167eaf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.440810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4c0d3-bdba-403b-a968-57a5aa423722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.441601 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4c0d3-bdba-403b-a968-57a5aa423722 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.441936 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4c0d3-bdba-403b-a968-57a5aa423722 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.442217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4c0d3-bdba-403b-a968-57a5aa423722 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.442949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4c0d3-bdba-403b-a968-57a5aa423722 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:21.443261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4c0d3-bdba-403b-a968-57a5aa423722 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.445109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4c0d3-bdba-403b-a968-57a5aa423722 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.466075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 298/602] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.467376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4c0d3-bdba-403b-a968-57a5aa423722 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.538777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad25d0-43c9-4a26-99af-865d39167eaf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.540363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.573793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.585611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4c0d3-bdba-403b-a968-57a5aa423722 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.587534 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47d0c-948b-4cb3-80ec-93bc9620c448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.588443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47d0c-948b-4cb3-80ec-93bc9620c448 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.588738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47d0c-948b-4cb3-80ec-93bc9620c448 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.589026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c47d0c-948b-4cb3-80ec-93bc9620c448 None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/079eeefcd0654dfe9cd4a9c51d239298/roles/87a7ef7c55854edb887513f9e471440c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.604210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47d0c-948b-4cb3-80ec-93bc9620c448 None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=079eeefcd0654dfe9cd4a9c51d239298, role_id=87a7ef7c55854edb887513f9e471440c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.605656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c47d0c-948b-4cb3-80ec-93bc9620c448 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.622417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f0a82c-5f40-4aa5-b9eb-764cd924e3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.623304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0a82c-5f40-4aa5-b9eb-764cd924e3ff None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.623589 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0a82c-5f40-4aa5-b9eb-764cd924e3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.623913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f0a82c-5f40-4aa5-b9eb-764cd924e3ff None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/395e7e721bf349f2bee876a23fc12291/roles/87a7ef7c55854edb887513f9e471440c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.638504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0a82c-5f40-4aa5-b9eb-764cd924e3ff None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=395e7e721bf349f2bee876a23fc12291, role_id=87a7ef7c55854edb887513f9e471440c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.639953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f0a82c-5f40-4aa5-b9eb-764cd924e3ff None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.690368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 305/603] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:24:21 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/079eeefcd0654dfe9cd4a9c51d239298/roles/87a7ef7c55854edb887513f9e471440c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:21.691348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47d0c-948b-4cb3-80ec-93bc9620c448 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.724193 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 299/604] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:24:21 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/395e7e721bf349f2bee876a23fc12291/roles/87a7ef7c55854edb887513f9e471440c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:21.726340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c202970-0973-4579-a587-ca25960cc461 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.726892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c202970-0973-4579-a587-ca25960cc461 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.728007 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c202970-0973-4579-a587-ca25960cc461 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.729863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 300/605] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:21.739166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a56d8-da02-4508-b874-e01108709e5e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.739993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a56d8-da02-4508-b874-e01108709e5e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.740603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4a56d8-da02-4508-b874-e01108709e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.773940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8a4a56d8-da02-4508-b874-e01108709e5e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:21.776289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8a4a56d8-da02-4508-b874-e01108709e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:21.847142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c47d0c-948b-4cb3-80ec-93bc9620c448 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:21.888592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade2918-0246-4582-a078-344dce1ba6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:21.889418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade2918-0246-4582-a078-344dce1ba6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.889742 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade2918-0246-4582-a078-344dce1ba6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.890030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade2918-0246-4582-a078-344dce1ba6d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.898832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade2918-0246-4582-a078-344dce1ba6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:21.900384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade2918-0246-4582-a078-344dce1ba6d7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9ade2918-0246-4582-a078-344dce1ba6d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:21.916165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:21.917119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:21.918011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:21.918011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:21.918011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:21.918011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:21.918011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:21.918011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:21.918011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:21.918011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:21.921995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 306/606] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:21.924165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade2918-0246-4582-a078-344dce1ba6d7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:21.949421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 301/607] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:21.981377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:21.987640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a56d8-da02-4508-b874-e01108709e5e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.063132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.073196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade2918-0246-4582-a078-344dce1ba6d7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.120061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1fcc-5e38-4580-a09b-de5d421e2b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.120061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1fcc-5e38-4580-a09b-de5d421e2b2e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.120724 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1fcc-5e38-4580-a09b-de5d421e2b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.120939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c1fcc-5e38-4580-a09b-de5d421e2b2e None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.122317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1fcc-5e38-4580-a09b-de5d421e2b2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:22.122641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1fcc-5e38-4580-a09b-de5d421e2b2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.124363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c1fcc-5e38-4580-a09b-de5d421e2b2e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.138350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4a56d8-da02-4508-b874-e01108709e5e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.142562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 307/608] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:22.148712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1fcc-5e38-4580-a09b-de5d421e2b2e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.186473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7550cd-fc0f-4d54-a194-352f16d7653f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.188361 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7550cd-fc0f-4d54-a194-352f16d7653f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.188653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7550cd-fc0f-4d54-a194-352f16d7653f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.188937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7550cd-fc0f-4d54-a194-352f16d7653f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.204231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7550cd-fc0f-4d54-a194-352f16d7653f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-3b7550cd-fc0f-4d54-a194-352f16d7653f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:22.216638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:22.217552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:22.219521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 302/609] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:22.225244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7550cd-fc0f-4d54-a194-352f16d7653f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.340892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.347816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c1fcc-5e38-4580-a09b-de5d421e2b2e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.377490 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7550cd-fc0f-4d54-a194-352f16d7653f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.385068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.388887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30913fec-bf12-4405-a32a-ce9a4c629999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.389819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30913fec-bf12-4405-a32a-ce9a4c629999 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.390138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30913fec-bf12-4405-a32a-ce9a4c629999 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.390981 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30913fec-bf12-4405-a32a-ce9a4c629999 None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/d7a0dbcea7ef4cdd9134f4c5a9cf5fb5/roles/87a7ef7c55854edb887513f9e471440c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.406940 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30913fec-bf12-4405-a32a-ce9a4c629999 None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=d7a0dbcea7ef4cdd9134f4c5a9cf5fb5, role_id=87a7ef7c55854edb887513f9e471440c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.408910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30913fec-bf12-4405-a32a-ce9a4c629999 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.413572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457b875-2814-4120-b07f-6f369a0e1a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.414316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457b875-2814-4120-b07f-6f369a0e1a0a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.414649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457b875-2814-4120-b07f-6f369a0e1a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.414890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457b875-2814-4120-b07f-6f369a0e1a0a None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.416024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457b875-2814-4120-b07f-6f369a0e1a0a None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:22.416692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457b875-2814-4120-b07f-6f369a0e1a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.418540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457b875-2814-4120-b07f-6f369a0e1a0a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.427268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 303/610] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:22.432767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a337392-9aa7-412e-8008-89e359ee9210 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.433139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a337392-9aa7-412e-8008-89e359ee9210 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.433492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a337392-9aa7-412e-8008-89e359ee9210 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.435033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 304/611] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:22.439812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a337392-9aa7-412e-8008-89e359ee9210 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.486285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 308/612] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:24:22 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/d7a0dbcea7ef4cdd9134f4c5a9cf5fb5/roles/87a7ef7c55854edb887513f9e471440c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:22.487496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84aa8-1c13-442c-9743-ff261e973e27 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.487796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84aa8-1c13-442c-9743-ff261e973e27 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.490276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa84aa8-1c13-442c-9743-ff261e973e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.518511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2fa84aa8-1c13-442c-9743-ff261e973e27 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:22.519959 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2fa84aa8-1c13-442c-9743-ff261e973e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:22.618622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a337392-9aa7-412e-8008-89e359ee9210 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.651326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 309/613] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:22.674681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa84aa8-1c13-442c-9743-ff261e973e27 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.701989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d427be-d358-456e-80e1-c28f0fe6ad1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.703295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d427be-d358-456e-80e1-c28f0fe6ad1d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.703582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d427be-d358-456e-80e1-c28f0fe6ad1d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.703861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d427be-d358-456e-80e1-c28f0fe6ad1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.717769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d427be-d358-456e-80e1-c28f0fe6ad1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.720612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d427be-d358-456e-80e1-c28f0fe6ad1d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-10d427be-d358-456e-80e1-c28f0fe6ad1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:22.740039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:22.741107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:22.741985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:22.741985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:22.741985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:22.741985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:22.742798 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 305/614] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:22.748644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d427be-d358-456e-80e1-c28f0fe6ad1d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.771560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.777226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.803664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa84aa8-1c13-442c-9743-ff261e973e27 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.844021 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f19b55-b1d2-46e6-81b9-789ef3962f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.845228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f19b55-b1d2-46e6-81b9-789ef3962f09 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.845796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f19b55-b1d2-46e6-81b9-789ef3962f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f19b55-b1d2-46e6-81b9-789ef3962f09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.859557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f19b55-b1d2-46e6-81b9-789ef3962f09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b3f19b55-b1d2-46e6-81b9-789ef3962f09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:22.868364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:22.869278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:22.870729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:22.873238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 310/615] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:22.878029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d427be-d358-456e-80e1-c28f0fe6ad1d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.887863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f19b55-b1d2-46e6-81b9-789ef3962f09 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.918724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518dfca-2b8d-4854-a4da-abb79da795db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.919564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518dfca-2b8d-4854-a4da-abb79da795db None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.919905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518dfca-2b8d-4854-a4da-abb79da795db None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.920260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518dfca-2b8d-4854-a4da-abb79da795db None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.921087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518dfca-2b8d-4854-a4da-abb79da795db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:22.921465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518dfca-2b8d-4854-a4da-abb79da795db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.923565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518dfca-2b8d-4854-a4da-abb79da795db None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.937440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 306/616] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:22.943904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518dfca-2b8d-4854-a4da-abb79da795db None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.065605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f19b55-b1d2-46e6-81b9-789ef3962f09 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.122046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.147151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5612b-d5ed-4378-9c6a-c6c1bd6d2be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.147826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5612b-d5ed-4378-9c6a-c6c1bd6d2be9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.148119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5612b-d5ed-4378-9c6a-c6c1bd6d2be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.148398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5612b-d5ed-4378-9c6a-c6c1bd6d2be9 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.149162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5612b-d5ed-4378-9c6a-c6c1bd6d2be9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:23.149471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5612b-d5ed-4378-9c6a-c6c1bd6d2be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.150878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5612b-d5ed-4378-9c6a-c6c1bd6d2be9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.165155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518dfca-2b8d-4854-a4da-abb79da795db None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.169842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 311/617] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:23.170042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.176223 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5612b-d5ed-4378-9c6a-c6c1bd6d2be9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.229220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862b1fb-730d-4b55-8d70-31674fce62f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.230421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862b1fb-730d-4b55-8d70-31674fce62f9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.230918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862b1fb-730d-4b55-8d70-31674fce62f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.231400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c862b1fb-730d-4b55-8d70-31674fce62f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.249566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862b1fb-730d-4b55-8d70-31674fce62f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.251257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c862b1fb-730d-4b55-8d70-31674fce62f9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c862b1fb-730d-4b55-8d70-31674fce62f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:23.277145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:23.278195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:23.279112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 307/618] 10.222.0.41 () {56 vars in 1093 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:23.286458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862b1fb-730d-4b55-8d70-31674fce62f9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.381202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5612b-d5ed-4378-9c6a-c6c1bd6d2be9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.426113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c862b1fb-730d-4b55-8d70-31674fce62f9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.466259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d728f7-7939-4030-b999-921cc6870328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.467138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d728f7-7939-4030-b999-921cc6870328 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.467429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d728f7-7939-4030-b999-921cc6870328 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.467708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d728f7-7939-4030-b999-921cc6870328 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.468584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d728f7-7939-4030-b999-921cc6870328 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:23.468897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d728f7-7939-4030-b999-921cc6870328 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.470530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d728f7-7939-4030-b999-921cc6870328 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.478353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8935-e069-4008-9314-d7565bb0f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.479157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8935-e069-4008-9314-d7565bb0f6df None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.479327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.479479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8935-e069-4008-9314-d7565bb0f6df None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.479723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd8935-e069-4008-9314-d7565bb0f6df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.491347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 308/619] 10.222.0.41 () {56 vars in 1133 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:23.502630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d728f7-7939-4030-b999-921cc6870328 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.509780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8935-e069-4008-9314-d7565bb0f6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.511357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd8935-e069-4008-9314-d7565bb0f6df None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-15fd8935-e069-4008-9314-d7565bb0f6df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:23.545744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:23.546756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:23.547642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:23.547642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:23.547642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:23.547642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:23.552721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 312/620] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:23.556010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8935-e069-4008-9314-d7565bb0f6df None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.667162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.702286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d728f7-7939-4030-b999-921cc6870328 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.751165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd8935-e069-4008-9314-d7565bb0f6df None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.762944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e92e7-0440-4c9f-82dc-f3d158b8407c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.763602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e92e7-0440-4c9f-82dc-f3d158b8407c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.763885 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e92e7-0440-4c9f-82dc-f3d158b8407c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.764159 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e92e7-0440-4c9f-82dc-f3d158b8407c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.813971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546e425-ccab-4252-b6d3-9bf28ddb1869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.814837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546e425-ccab-4252-b6d3-9bf28ddb1869 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.815117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546e425-ccab-4252-b6d3-9bf28ddb1869 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.815395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546e425-ccab-4252-b6d3-9bf28ddb1869 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.816112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546e425-ccab-4252-b6d3-9bf28ddb1869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:23.817600 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546e425-ccab-4252-b6d3-9bf28ddb1869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.818998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546e425-ccab-4252-b6d3-9bf28ddb1869 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.849294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 313/621] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:23.850569 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546e425-ccab-4252-b6d3-9bf28ddb1869 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.869350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.883251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e92e7-0440-4c9f-82dc-f3d158b8407c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.884722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e92e7-0440-4c9f-82dc-f3d158b8407c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.040070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546e425-ccab-4252-b6d3-9bf28ddb1869 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.055087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.065231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 309/622] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:24.070581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e92e7-0440-4c9f-82dc-f3d158b8407c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.085788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ee26e-c965-4aa1-91a4-0394ea4e1f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.085788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee26e-c965-4aa1-91a4-0394ea4e1f1a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.085788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee26e-c965-4aa1-91a4-0394ea4e1f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.085788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee26e-c965-4aa1-91a4-0394ea4e1f1a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.107425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ee26e-c965-4aa1-91a4-0394ea4e1f1a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.111202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ee26e-c965-4aa1-91a4-0394ea4e1f1a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a12ee26e-c965-4aa1-91a4-0394ea4e1f1a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:24.130311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:24.131483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:24.132612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:24.132612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:24.132612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:24.132612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:24.132612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:24.132612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:24.132612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:24.132612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:24.132612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:24.132612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:24.134762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 314/623] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:24.150638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ee26e-c965-4aa1-91a4-0394ea4e1f1a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.211625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.218858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e92e7-0440-4c9f-82dc-f3d158b8407c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.256155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1b50f-dcc4-4732-8d8b-d842beb3d8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.257312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1b50f-dcc4-4732-8d8b-d842beb3d8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.257812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1b50f-dcc4-4732-8d8b-d842beb3d8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.258266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1b50f-dcc4-4732-8d8b-d842beb3d8e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.269378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1b50f-dcc4-4732-8d8b-d842beb3d8e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.271019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1b50f-dcc4-4732-8d8b-d842beb3d8e6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-d5b1b50f-dcc4-4732-8d8b-d842beb3d8e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:24.289513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:24.290728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:24.291725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:24.291725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:24.291725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:24.291725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:24.293508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 310/624] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:24.299182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ae58d-d6b6-4b09-ac1a-79679947bff5 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.299320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ee26e-c965-4aa1-91a4-0394ea4e1f1a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.299878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ae58d-d6b6-4b09-ac1a-79679947bff5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.300360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ae58d-d6b6-4b09-ac1a-79679947bff5 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.302173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 311/625] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:24.303104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ae58d-d6b6-4b09-ac1a-79679947bff5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.334069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898520d9-819b-4f45-9401-96788537e751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.334741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898520d9-819b-4f45-9401-96788537e751 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.335030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898520d9-819b-4f45-9401-96788537e751 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.335341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898520d9-819b-4f45-9401-96788537e751 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.336140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898520d9-819b-4f45-9401-96788537e751 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:24.336452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898520d9-819b-4f45-9401-96788537e751 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.338095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898520d9-819b-4f45-9401-96788537e751 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.355946 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 315/626] 10.222.0.41 () {56 vars in 1135 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.357320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecad0a-1787-4d8e-b006-32629a064126 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.357575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecad0a-1787-4d8e-b006-32629a064126 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.357881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecad0a-1787-4d8e-b006-32629a064126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.374950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d7ecad0a-1787-4d8e-b006-32629a064126 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:24.376145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d7ecad0a-1787-4d8e-b006-32629a064126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:24.403289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.420118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ae58d-d6b6-4b09-ac1a-79679947bff5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.452693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 316/627] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:24.453560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecad0a-1787-4d8e-b006-32629a064126 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.459058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bd8d1-948d-4e62-b5c2-ce25949752aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.460037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bd8d1-948d-4e62-b5c2-ce25949752aa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.460599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bd8d1-948d-4e62-b5c2-ce25949752aa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.461097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bd8d1-948d-4e62-b5c2-ce25949752aa None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.462111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bd8d1-948d-4e62-b5c2-ce25949752aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:24.462694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bd8d1-948d-4e62-b5c2-ce25949752aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.464388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bd8d1-948d-4e62-b5c2-ce25949752aa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.478053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 312/628] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.483720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bd8d1-948d-4e62-b5c2-ce25949752aa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.496478 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.561947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecad0a-1787-4d8e-b006-32629a064126 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.592951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bd8d1-948d-4e62-b5c2-ce25949752aa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.599024 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea14e-5dc7-4201-929c-92cc158fce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.599828 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea14e-5dc7-4201-929c-92cc158fce39 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.600114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea14e-5dc7-4201-929c-92cc158fce39 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.600393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea14e-5dc7-4201-929c-92cc158fce39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.612736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ea14e-5dc7-4201-929c-92cc158fce39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.614217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ea14e-5dc7-4201-929c-92cc158fce39 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.629976 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b388949-1ad9-4fdb-aa06-8c6855ac3d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.630775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388949-1ad9-4fdb-aa06-8c6855ac3d1f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.631065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388949-1ad9-4fdb-aa06-8c6855ac3d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.631370 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b388949-1ad9-4fdb-aa06-8c6855ac3d1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-106ea14e-5dc7-4201-929c-92cc158fce39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:24.633523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:24.634394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:24.638791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:24.638791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:24.638791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:24.638791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:24.638791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 317/629] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:24.638791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea14e-5dc7-4201-929c-92cc158fce39 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.643115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b388949-1ad9-4fdb-aa06-8c6855ac3d1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.644600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b388949-1ad9-4fdb-aa06-8c6855ac3d1f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.654451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9b388949-1ad9-4fdb-aa06-8c6855ac3d1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:24.659974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:24.660889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:24.662375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:24.662375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:24.662375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:24.662375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:24.662375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:24.662375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:24.662375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:24.662375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:24.662375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 313/630] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:24.662866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939252ee-e5d1-4cf1-93ed-03240df56d7a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.663093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939252ee-e5d1-4cf1-93ed-03240df56d7a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.663401 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939252ee-e5d1-4cf1-93ed-03240df56d7a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.669030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 314/631] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:24.669030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939252ee-e5d1-4cf1-93ed-03240df56d7a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.745483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.754008 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea14e-5dc7-4201-929c-92cc158fce39 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.781857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939252ee-e5d1-4cf1-93ed-03240df56d7a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.791066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d1e49-35cc-4122-9310-6c549889813e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.791870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1e49-35cc-4122-9310-6c549889813e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.792606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1e49-35cc-4122-9310-6c549889813e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.792897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1e49-35cc-4122-9310-6c549889813e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.804958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d1e49-35cc-4122-9310-6c549889813e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-952d1e49-35cc-4122-9310-6c549889813e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:24.812781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:24.813727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:24.814545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 318/632] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:24.815230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d1e49-35cc-4122-9310-6c549889813e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.823549 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51824e2-02a4-4d3c-995c-cbe2d46891bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.824236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51824e2-02a4-4d3c-995c-cbe2d46891bd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.824521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51824e2-02a4-4d3c-995c-cbe2d46891bd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.824802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51824e2-02a4-4d3c-995c-cbe2d46891bd None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.825533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51824e2-02a4-4d3c-995c-cbe2d46891bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:24.825907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51824e2-02a4-4d3c-995c-cbe2d46891bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.827290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51824e2-02a4-4d3c-995c-cbe2d46891bd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.844051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 315/633] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.844051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef98a-f3d9-4e79-a413-35cbd6b887c5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.844051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef98a-f3d9-4e79-a413-35cbd6b887c5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.844051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef98a-f3d9-4e79-a413-35cbd6b887c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.860664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-972ef98a-f3d9-4e79-a413-35cbd6b887c5 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:24.861886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-972ef98a-f3d9-4e79-a413-35cbd6b887c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:24.895339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.929737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d1e49-35cc-4122-9310-6c549889813e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.949692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 316/634] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:24.949692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef98a-f3d9-4e79-a413-35cbd6b887c5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.969236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb34d56-4547-471f-8325-01e7439e3ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.970289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb34d56-4547-471f-8325-01e7439e3ffc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.970438 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb34d56-4547-471f-8325-01e7439e3ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.970697 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb34d56-4547-471f-8325-01e7439e3ffc None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.971612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb34d56-4547-471f-8325-01e7439e3ffc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:24.972049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb34d56-4547-471f-8325-01e7439e3ffc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.973544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb34d56-4547-471f-8325-01e7439e3ffc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.985976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 319/635] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.986863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb34d56-4547-471f-8325-01e7439e3ffc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.021618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.072154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef98a-f3d9-4e79-a413-35cbd6b887c5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.100593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb34d56-4547-471f-8325-01e7439e3ffc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.109270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d011c30-1f07-450c-afd2-6d36d0f76d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.109973 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011c30-1f07-450c-afd2-6d36d0f76d07 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.110434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011c30-1f07-450c-afd2-6d36d0f76d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.110544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d011c30-1f07-450c-afd2-6d36d0f76d07 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.111273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d011c30-1f07-450c-afd2-6d36d0f76d07 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:25.111822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d011c30-1f07-450c-afd2-6d36d0f76d07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.112994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d011c30-1f07-450c-afd2-6d36d0f76d07 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.122207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 317/636] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.123132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d011c30-1f07-450c-afd2-6d36d0f76d07 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.132077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.136737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab46f1d-1841-45db-b061-5c799e50ab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.137523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab46f1d-1841-45db-b061-5c799e50ab5f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.137849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab46f1d-1841-45db-b061-5c799e50ab5f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.138127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab46f1d-1841-45db-b061-5c799e50ab5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.145465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab46f1d-1841-45db-b061-5c799e50ab5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.146947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab46f1d-1841-45db-b061-5c799e50ab5f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7ab46f1d-1841-45db-b061-5c799e50ab5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:25.160913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:25.162387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:25.163230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:25.163230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:25.163230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:25.163230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:25.163230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:25.163230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:25.163230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:25.163230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:25.163230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 320/637] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:25.163695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab46f1d-1841-45db-b061-5c799e50ab5f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.222381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d011c30-1f07-450c-afd2-6d36d0f76d07 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.242057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.256280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f653b7-635a-4413-a2a4-819b22ab0d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.257079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f653b7-635a-4413-a2a4-819b22ab0d0d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.257368 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f653b7-635a-4413-a2a4-819b22ab0d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.257648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f653b7-635a-4413-a2a4-819b22ab0d0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.264257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab46f1d-1841-45db-b061-5c799e50ab5f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.268609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f653b7-635a-4413-a2a4-819b22ab0d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e9f653b7-635a-4413-a2a4-819b22ab0d0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:25.276346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:25.277369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:25.278220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 318/638] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:25.279108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2480-cdc5-4edb-8a86-06a081481f14 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.279175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2480-cdc5-4edb-8a86-06a081481f14 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.279402 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce2480-cdc5-4edb-8a86-06a081481f14 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.280654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 319/639] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:25.281331 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2480-cdc5-4edb-8a86-06a081481f14 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.302267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857809dd-bc07-42a4-be1b-b0cce36b13d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.303015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857809dd-bc07-42a4-be1b-b0cce36b13d6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.303306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857809dd-bc07-42a4-be1b-b0cce36b13d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.303589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857809dd-bc07-42a4-be1b-b0cce36b13d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.304407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857809dd-bc07-42a4-be1b-b0cce36b13d6 None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=a1e4a66515654e1f9f7452740ff4ce58) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:25.304726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857809dd-bc07-42a4-be1b-b0cce36b13d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.306203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857809dd-bc07-42a4-be1b-b0cce36b13d6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.312671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 321/640] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/role_assignments?user.id=a1e4a66515654e1f9f7452740ff4ce58&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.313428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857809dd-bc07-42a4-be1b-b0cce36b13d6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.390535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.393078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce2480-cdc5-4edb-8a86-06a081481f14 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.434275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347fe07-26cc-48e1-b3eb-2db9142e6fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.435090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347fe07-26cc-48e1-b3eb-2db9142e6fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.435378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347fe07-26cc-48e1-b3eb-2db9142e6fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.435900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347fe07-26cc-48e1-b3eb-2db9142e6fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.443144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857809dd-bc07-42a4-be1b-b0cce36b13d6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.447242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347fe07-26cc-48e1-b3eb-2db9142e6fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.448731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347fe07-26cc-48e1-b3eb-2db9142e6fb8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1347fe07-26cc-48e1-b3eb-2db9142e6fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:25.468558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:25.469617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:25.470544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:25.470544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:25.470544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:25.470544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:25.470544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 320/641] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:25.470834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347fe07-26cc-48e1-b3eb-2db9142e6fb8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.486198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86329b6-610c-4de8-8f40-aeec83638586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.486879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86329b6-610c-4de8-8f40-aeec83638586 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.487168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86329b6-610c-4de8-8f40-aeec83638586 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.487453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86329b6-610c-4de8-8f40-aeec83638586 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.488250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86329b6-610c-4de8-8f40-aeec83638586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:25.488570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86329b6-610c-4de8-8f40-aeec83638586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.490043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86329b6-610c-4de8-8f40-aeec83638586 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.503192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 322/642] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.504602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fac1a-e884-4b2b-8ec9-bb70de4efe10 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.504902 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fac1a-e884-4b2b-8ec9-bb70de4efe10 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.505186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fac1a-e884-4b2b-8ec9-bb70de4efe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.509284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.524284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0b1fac1a-e884-4b2b-8ec9-bb70de4efe10 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:25.525515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0b1fac1a-e884-4b2b-8ec9-bb70de4efe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:25.588939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347fe07-26cc-48e1-b3eb-2db9142e6fb8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.600439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 323/643] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:25.601550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fac1a-e884-4b2b-8ec9-bb70de4efe10 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.630661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2974e-9ab2-46b8-8d8e-c19194c83003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.631461 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2974e-9ab2-46b8-8d8e-c19194c83003 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.631744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2974e-9ab2-46b8-8d8e-c19194c83003 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.632019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2974e-9ab2-46b8-8d8e-c19194c83003 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.632762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2974e-9ab2-46b8-8d8e-c19194c83003 None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:25.633066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2974e-9ab2-46b8-8d8e-c19194c83003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.634468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb2974e-9ab2-46b8-8d8e-c19194c83003 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.648553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 321/644] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.648553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2974e-9ab2-46b8-8d8e-c19194c83003 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.652675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.710621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fac1a-e884-4b2b-8ec9-bb70de4efe10 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.746922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.749434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f848d27-cedc-41f5-a616-abc50421bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.750154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f848d27-cedc-41f5-a616-abc50421bc68 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.750439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f848d27-cedc-41f5-a616-abc50421bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.750718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f848d27-cedc-41f5-a616-abc50421bc68 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.751460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f848d27-cedc-41f5-a616-abc50421bc68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:25.751738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f848d27-cedc-41f5-a616-abc50421bc68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.753112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f848d27-cedc-41f5-a616-abc50421bc68 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.753880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb2974e-9ab2-46b8-8d8e-c19194c83003 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.765615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 324/645] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.766488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f848d27-cedc-41f5-a616-abc50421bc68 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.795354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd984e-9750-47b5-b147-62c94f4e5998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.796904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd984e-9750-47b5-b147-62c94f4e5998 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.797180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd984e-9750-47b5-b147-62c94f4e5998 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.797495 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd984e-9750-47b5-b147-62c94f4e5998 None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/af5ebb39734144418fe35f9f0a679145/roles/87a7ef7c55854edb887513f9e471440c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.812307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd984e-9750-47b5-b147-62c94f4e5998 None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=af5ebb39734144418fe35f9f0a679145, role_id=87a7ef7c55854edb887513f9e471440c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.813778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd984e-9750-47b5-b147-62c94f4e5998 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.868314 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f848d27-cedc-41f5-a616-abc50421bc68 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.876455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.889309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 322/646] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:24:25 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/af5ebb39734144418fe35f9f0a679145/roles/87a7ef7c55854edb887513f9e471440c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:25.890461 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd984e-9750-47b5-b147-62c94f4e5998 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.915096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88042458-1055-4e3e-b36f-badf409b5042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.915096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88042458-1055-4e3e-b36f-badf409b5042 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.915096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88042458-1055-4e3e-b36f-badf409b5042 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.915096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88042458-1055-4e3e-b36f-badf409b5042 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.928466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88042458-1055-4e3e-b36f-badf409b5042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-88042458-1055-4e3e-b36f-badf409b5042 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:25.938111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:25.939178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:25.940117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:25.943389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 325/647] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:25.944477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88042458-1055-4e3e-b36f-badf409b5042 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.034727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd984e-9750-47b5-b147-62c94f4e5998 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.067615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88042458-1055-4e3e-b36f-badf409b5042 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.085389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a873a90-8013-4cdb-bde5-9674e82e5661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.086384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a873a90-8013-4cdb-bde5-9674e82e5661 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.087460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a873a90-8013-4cdb-bde5-9674e82e5661 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.087841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a873a90-8013-4cdb-bde5-9674e82e5661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.103088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a873a90-8013-4cdb-bde5-9674e82e5661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.104861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a873a90-8013-4cdb-bde5-9674e82e5661 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.117404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b4c05-a231-43aa-9315-3f4445080b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.118253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b4c05-a231-43aa-9315-3f4445080b81 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.118542 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b4c05-a231-43aa-9315-3f4445080b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.118823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b4c05-a231-43aa-9315-3f4445080b81 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.122072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0a873a90-8013-4cdb-bde5-9674e82e5661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:26.127083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:26.128109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:26.129189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:26.129189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:26.129189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:26.129189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:26.129955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b4c05-a231-43aa-9315-3f4445080b81 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.131246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 323/648] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:26.132242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a873a90-8013-4cdb-bde5-9674e82e5661 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.135786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b4c05-a231-43aa-9315-3f4445080b81 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-962b4c05-a231-43aa-9315-3f4445080b81 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:26.151578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:26.152751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:26.153896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:26.153896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:26.153896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:26.153896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:26.153896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:26.153896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:26.153896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:26.153896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:26.153896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:24:26.153896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:26.157461 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 326/649] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:26.158372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b4c05-a231-43aa-9315-3f4445080b81 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.187728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.244605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a873a90-8013-4cdb-bde5-9674e82e5661 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.263836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b4c05-a231-43aa-9315-3f4445080b81 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.286872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810afe2-cb9d-4e77-8261-9562fda4405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.287871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810afe2-cb9d-4e77-8261-9562fda4405d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.288351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810afe2-cb9d-4e77-8261-9562fda4405d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.288774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810afe2-cb9d-4e77-8261-9562fda4405d None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.289726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810afe2-cb9d-4e77-8261-9562fda4405d None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:26.290358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810afe2-cb9d-4e77-8261-9562fda4405d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.292058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810afe2-cb9d-4e77-8261-9562fda4405d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.299619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc31258-525a-405e-99eb-7694ac4be3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.300412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc31258-525a-405e-99eb-7694ac4be3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.300804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc31258-525a-405e-99eb-7694ac4be3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.301212 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc31258-525a-405e-99eb-7694ac4be3c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.302078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc31258-525a-405e-99eb-7694ac4be3c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:26.302493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc31258-525a-405e-99eb-7694ac4be3c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.303688 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 324/650] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:26.304684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810afe2-cb9d-4e77-8261-9562fda4405d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.308936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc31258-525a-405e-99eb-7694ac4be3c4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.325729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 327/651] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:26.326696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc31258-525a-405e-99eb-7694ac4be3c4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.369589 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.416373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810afe2-cb9d-4e77-8261-9562fda4405d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.437079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.454874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc31258-525a-405e-99eb-7694ac4be3c4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.464816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072347f-1265-4072-8ead-5a4046012423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.465721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072347f-1265-4072-8ead-5a4046012423 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.466150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072347f-1265-4072-8ead-5a4046012423 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.466571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072347f-1265-4072-8ead-5a4046012423 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.468018 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072347f-1265-4072-8ead-5a4046012423 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:26.469450 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072347f-1265-4072-8ead-5a4046012423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.471333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072347f-1265-4072-8ead-5a4046012423 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.495748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146cb64-0bcf-41cd-b148-bf2736a3d592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.496750 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146cb64-0bcf-41cd-b148-bf2736a3d592 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.497067 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146cb64-0bcf-41cd-b148-bf2736a3d592 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.497446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146cb64-0bcf-41cd-b148-bf2736a3d592 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.501038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 325/652] 10.222.0.41 () {56 vars in 1137 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:26.502243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072347f-1265-4072-8ead-5a4046012423 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.512988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146cb64-0bcf-41cd-b148-bf2736a3d592 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.514627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146cb64-0bcf-41cd-b148-bf2736a3d592 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c146cb64-0bcf-41cd-b148-bf2736a3d592 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:26.534615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:26.535736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:26.536896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:26.536896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:26.536896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:26.536896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:26.542613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 328/653] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:26.543779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146cb64-0bcf-41cd-b148-bf2736a3d592 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.643831 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072347f-1265-4072-8ead-5a4046012423 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.652525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146cb64-0bcf-41cd-b148-bf2736a3d592 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.663921 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.683704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaee6e8-4c62-4b51-ac58-84b5ff07e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.684777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaee6e8-4c62-4b51-ac58-84b5ff07e462 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.685299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaee6e8-4c62-4b51-ac58-84b5ff07e462 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.685812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaee6e8-4c62-4b51-ac58-84b5ff07e462 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.689424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72badbc-81f9-41b5-a6d9-a13524a2de09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.690170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72badbc-81f9-41b5-a6d9-a13524a2de09 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.690614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72badbc-81f9-41b5-a6d9-a13524a2de09 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.690981 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72badbc-81f9-41b5-a6d9-a13524a2de09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.696347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaee6e8-4c62-4b51-ac58-84b5ff07e462 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.698205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaee6e8-4c62-4b51-ac58-84b5ff07e462 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.699894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-eaaee6e8-4c62-4b51-ac58-84b5ff07e462 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:26.714513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:26.715660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:26.716772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:26.716772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:26.716772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:26.716772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:26.716772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:26.716772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:26.716772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:26.716772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:26.716772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:24:26.716772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:26.719508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 326/654] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:26.720660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaee6e8-4c62-4b51-ac58-84b5ff07e462 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.762241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72badbc-81f9-41b5-a6d9-a13524a2de09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.763770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72badbc-81f9-41b5-a6d9-a13524a2de09 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.830295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaee6e8-4c62-4b51-ac58-84b5ff07e462 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.863659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 329/655] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:26.864559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72badbc-81f9-41b5-a6d9-a13524a2de09 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.867692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bfe5a-67bc-4f36-8a16-963fe70bac0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.868704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bfe5a-67bc-4f36-8a16-963fe70bac0b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.869215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bfe5a-67bc-4f36-8a16-963fe70bac0b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.869712 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bfe5a-67bc-4f36-8a16-963fe70bac0b None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.870887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bfe5a-67bc-4f36-8a16-963fe70bac0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:26.871390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bfe5a-67bc-4f36-8a16-963fe70bac0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.872956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bfe5a-67bc-4f36-8a16-963fe70bac0b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.886298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 327/656] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:26.887504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bfe5a-67bc-4f36-8a16-963fe70bac0b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.921561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.925878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.981551 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72badbc-81f9-41b5-a6d9-a13524a2de09 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.994533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bfe5a-67bc-4f36-8a16-963fe70bac0b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.018468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690d113-8204-459c-a7cd-dd4f9eabf609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.019145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690d113-8204-459c-a7cd-dd4f9eabf609 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.019440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690d113-8204-459c-a7cd-dd4f9eabf609 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.019769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690d113-8204-459c-a7cd-dd4f9eabf609 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.020765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690d113-8204-459c-a7cd-dd4f9eabf609 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:27.021080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690d113-8204-459c-a7cd-dd4f9eabf609 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.022602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690d113-8204-459c-a7cd-dd4f9eabf609 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.036912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb59fec-25b6-4008-851b-e3b885573608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.038182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb59fec-25b6-4008-851b-e3b885573608 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.038696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb59fec-25b6-4008-851b-e3b885573608 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.039173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb59fec-25b6-4008-851b-e3b885573608 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.041811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 330/657] 10.222.0.41 () {56 vars in 1137 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:27.042652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690d113-8204-459c-a7cd-dd4f9eabf609 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.052068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb59fec-25b6-4008-851b-e3b885573608 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.053961 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb59fec-25b6-4008-851b-e3b885573608 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-fcb59fec-25b6-4008-851b-e3b885573608 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:27.072694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:27.073581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:27.074475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:27.074475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:27.074475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:27.074475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:27.078219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 328/658] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:27.079292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb59fec-25b6-4008-851b-e3b885573608 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.143937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.149595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690d113-8204-459c-a7cd-dd4f9eabf609 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.177261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.186107 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342a268-fc62-42d7-812e-22823bc9095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.186741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342a268-fc62-42d7-812e-22823bc9095d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.187161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342a268-fc62-42d7-812e-22823bc9095d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.187464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342a268-fc62-42d7-812e-22823bc9095d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.192930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb59fec-25b6-4008-851b-e3b885573608 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.195169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342a268-fc62-42d7-812e-22823bc9095d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.196696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342a268-fc62-42d7-812e-22823bc9095d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8342a268-fc62-42d7-812e-22823bc9095d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:27.211989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:27.212953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:27.213949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 331/659] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:27.214561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342a268-fc62-42d7-812e-22823bc9095d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.242538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8765-3526-4c45-966a-ae0b8cb22f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.243802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8765-3526-4c45-966a-ae0b8cb22f6c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.244100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8765-3526-4c45-966a-ae0b8cb22f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.244389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42af8765-3526-4c45-966a-ae0b8cb22f6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.318550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af8765-3526-4c45-966a-ae0b8cb22f6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.320709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42af8765-3526-4c45-966a-ae0b8cb22f6c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.327944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342a268-fc62-42d7-812e-22823bc9095d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.364961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfce7bb-1484-4b4d-9867-05be0589f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.366093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce7bb-1484-4b4d-9867-05be0589f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.366379 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce7bb-1484-4b4d-9867-05be0589f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.366758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce7bb-1484-4b4d-9867-05be0589f6f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.367613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfce7bb-1484-4b4d-9867-05be0589f6f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:27.368192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfce7bb-1484-4b4d-9867-05be0589f6f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.369580 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfce7bb-1484-4b4d-9867-05be0589f6f5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.383003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 332/660] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:27.383919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfce7bb-1484-4b4d-9867-05be0589f6f5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.402450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.416380 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.429738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 329/661] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:27.430591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8765-3526-4c45-966a-ae0b8cb22f6c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.496023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfce7bb-1484-4b4d-9867-05be0589f6f5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.536529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caf772-77f2-4887-869f-d89d231b3ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.537802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caf772-77f2-4887-869f-d89d231b3ddd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.538317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caf772-77f2-4887-869f-d89d231b3ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.538807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caf772-77f2-4887-869f-d89d231b3ddd None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.539875 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34caf772-77f2-4887-869f-d89d231b3ddd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:27.540463 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34caf772-77f2-4887-869f-d89d231b3ddd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.542293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34caf772-77f2-4887-869f-d89d231b3ddd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.544015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42af8765-3526-4c45-966a-ae0b8cb22f6c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.565784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 333/662] 10.222.0.41 () {56 vars in 1139 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:27.567181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caf772-77f2-4887-869f-d89d231b3ddd None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.580911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f35b5-c500-40a1-83a5-b50db03cba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.581752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f35b5-c500-40a1-83a5-b50db03cba69 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.582044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f35b5-c500-40a1-83a5-b50db03cba69 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.582340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f35b5-c500-40a1-83a5-b50db03cba69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.589339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f35b5-c500-40a1-83a5-b50db03cba69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.590842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f35b5-c500-40a1-83a5-b50db03cba69 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0c1f35b5-c500-40a1-83a5-b50db03cba69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:27.605113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:27.606054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:27.606914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:27.606914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:27.606914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:27.606914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:27.606914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:27.606914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:27.606914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:27.606914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:27.606914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 330/663] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:27.607883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f35b5-c500-40a1-83a5-b50db03cba69 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.656214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.659089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.683343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caf772-77f2-4887-869f-d89d231b3ddd None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.711231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f35b5-c500-40a1-83a5-b50db03cba69 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.721645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fc91-fe7c-48c5-9d96-b77564c68b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.722781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fc91-fe7c-48c5-9d96-b77564c68b0d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.723228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fc91-fe7c-48c5-9d96-b77564c68b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.723661 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f9fc91-fe7c-48c5-9d96-b77564c68b0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.735442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9fc91-fe7c-48c5-9d96-b77564c68b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.736939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f9fc91-fe7c-48c5-9d96-b77564c68b0d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.747575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f142700-0ea1-443e-ae4e-b216cb2fa8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.748171 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f142700-0ea1-443e-ae4e-b216cb2fa8bb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.748458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f142700-0ea1-443e-ae4e-b216cb2fa8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.748737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f142700-0ea1-443e-ae4e-b216cb2fa8bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-90f9fc91-fe7c-48c5-9d96-b77564c68b0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:27.756129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:27.757031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:27.758623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:27.758623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:27.758623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:27.758623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:27.758623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 334/664] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:27.758898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fc91-fe7c-48c5-9d96-b77564c68b0d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.831382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f142700-0ea1-443e-ae4e-b216cb2fa8bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.832848 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f142700-0ea1-443e-ae4e-b216cb2fa8bb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.863647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f9fc91-fe7c-48c5-9d96-b77564c68b0d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.881562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.891227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.899700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d36f8-8ded-4e24-8196-b1d938e1626b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.900365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d36f8-8ded-4e24-8196-b1d938e1626b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.900655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d36f8-8ded-4e24-8196-b1d938e1626b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.900942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d36f8-8ded-4e24-8196-b1d938e1626b None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.901752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d36f8-8ded-4e24-8196-b1d938e1626b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:27.902069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d36f8-8ded-4e24-8196-b1d938e1626b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.903506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d36f8-8ded-4e24-8196-b1d938e1626b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.915240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 335/665] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:27.921863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0adb32-8a47-4cc0-8f21-b25af5ca33cb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.922142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0adb32-8a47-4cc0-8f21-b25af5ca33cb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.922432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0adb32-8a47-4cc0-8f21-b25af5ca33cb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.923717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 336/666] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:27.927618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0adb32-8a47-4cc0-8f21-b25af5ca33cb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.941782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 331/667] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:27.942956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f142700-0ea1-443e-ae4e-b216cb2fa8bb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.044842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0adb32-8a47-4cc0-8f21-b25af5ca33cb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.050837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f142700-0ea1-443e-ae4e-b216cb2fa8bb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.085491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9b7d-4fb7-4dbc-bb0d-c1e9dedf795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.086367 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9b7d-4fb7-4dbc-bb0d-c1e9dedf795d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.086804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9b7d-4fb7-4dbc-bb0d-c1e9dedf795d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.087231 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9b7d-4fb7-4dbc-bb0d-c1e9dedf795d None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.088124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9b7d-4fb7-4dbc-bb0d-c1e9dedf795d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:28.088584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9b7d-4fb7-4dbc-bb0d-c1e9dedf795d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.090478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd9b7d-4fb7-4dbc-bb0d-c1e9dedf795d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.092346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3cd83-ff11-4f1f-89c2-100799d3759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.093564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3cd83-ff11-4f1f-89c2-100799d3759e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.094331 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3cd83-ff11-4f1f-89c2-100799d3759e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.094621 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3cd83-ff11-4f1f-89c2-100799d3759e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.095469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3cd83-ff11-4f1f-89c2-100799d3759e None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=395e7e721bf349f2bee876a23fc12291) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:28.095787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3cd83-ff11-4f1f-89c2-100799d3759e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.097226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3cd83-ff11-4f1f-89c2-100799d3759e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.108455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 332/668] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/role_assignments?user.id=395e7e721bf349f2bee876a23fc12291&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:28.108455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68f8d-7ad8-42c7-9173-eee285caf065 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.108455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68f8d-7ad8-42c7-9173-eee285caf065 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.108455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a68f8d-7ad8-42c7-9173-eee285caf065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.109568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 337/669] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:28.110798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9b7d-4fb7-4dbc-bb0d-c1e9dedf795d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.127274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d7a68f8d-7ad8-42c7-9173-eee285caf065 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:28.128650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d7a68f8d-7ad8-42c7-9173-eee285caf065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:28.137928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:28.166142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:28.207733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 333/670] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:28.208894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a68f8d-7ad8-42c7-9173-eee285caf065 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.238432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9b7d-4fb7-4dbc-bb0d-c1e9dedf795d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.282329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3a182f-622b-4085-843e-9ecdc89027bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.283527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a182f-622b-4085-843e-9ecdc89027bc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.284162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a182f-622b-4085-843e-9ecdc89027bc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.284942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3a182f-622b-4085-843e-9ecdc89027bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.296633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a182f-622b-4085-843e-9ecdc89027bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.298059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3a182f-622b-4085-843e-9ecdc89027bc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ed3a182f-622b-4085-843e-9ecdc89027bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:28.318337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:28.319422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:28.320474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:28.320474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:28.320474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:28.320474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:28.320474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 338/671] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:28.320812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf49da-4e84-413f-aca7-030f06d166b3 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.321058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf49da-4e84-413f-aca7-030f06d166b3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.321339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf49da-4e84-413f-aca7-030f06d166b3 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.323645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 339/672] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:28.325762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf49da-4e84-413f-aca7-030f06d166b3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.335587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a68f8d-7ad8-42c7-9173-eee285caf065 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.374539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbb06-8ad5-40c9-8894-5636428edf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.375625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbb06-8ad5-40c9-8894-5636428edf06 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.376101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbb06-8ad5-40c9-8894-5636428edf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.376571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbb06-8ad5-40c9-8894-5636428edf06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.384141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dbb06-8ad5-40c9-8894-5636428edf06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.385922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3dbb06-8ad5-40c9-8894-5636428edf06 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-aa3dbb06-8ad5-40c9-8894-5636428edf06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:28.400857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:28.401911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:28.403072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:28.403072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:28.403072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:28.403072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:28.403072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:28.403072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:28.403072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:28.403072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:28.405290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 334/673] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:28.406760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbb06-8ad5-40c9-8894-5636428edf06 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.412240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:28.433308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:28.438445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf49da-4e84-413f-aca7-030f06d166b3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.474840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1cc6da-5402-438b-a0b1-b0d275599e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.475552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc6da-5402-438b-a0b1-b0d275599e18 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.475831 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc6da-5402-438b-a0b1-b0d275599e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.476283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1cc6da-5402-438b-a0b1-b0d275599e18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.487185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1cc6da-5402-438b-a0b1-b0d275599e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-cd1cc6da-5402-438b-a0b1-b0d275599e18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:28.494885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:28.496263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 340/674] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:28.502083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4761c42-559d-41c0-acf7-09242d3abb0e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.502830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4761c42-559d-41c0-acf7-09242d3abb0e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.502830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4761c42-559d-41c0-acf7-09242d3abb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.519171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e4761c42-559d-41c0-acf7-09242d3abb0e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:28.520365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e4761c42-559d-41c0-acf7-09242d3abb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:28.521607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbb06-8ad5-40c9-8894-5636428edf06 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.557625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e23c5d-6abe-43a0-9112-4496a908d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.558370 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e23c5d-6abe-43a0-9112-4496a908d0ff None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.558728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e23c5d-6abe-43a0-9112-4496a908d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.559014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e23c5d-6abe-43a0-9112-4496a908d0ff None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.559739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e23c5d-6abe-43a0-9112-4496a908d0ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:28.560048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e23c5d-6abe-43a0-9112-4496a908d0ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.561428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e23c5d-6abe-43a0-9112-4496a908d0ff None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.578285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 335/675] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:28.578285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e23c5d-6abe-43a0-9112-4496a908d0ff None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.597399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 341/676] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:28.598518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4761c42-559d-41c0-acf7-09242d3abb0e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.651228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:28.693819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e23c5d-6abe-43a0-9112-4496a908d0ff None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.700510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:28.713607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4761c42-559d-41c0-acf7-09242d3abb0e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.730271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab3e9-8dd6-4614-8624-a7bf32814ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.730934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab3e9-8dd6-4614-8624-a7bf32814ced None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.731218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab3e9-8dd6-4614-8624-a7bf32814ced None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.731494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ab3e9-8dd6-4614-8624-a7bf32814ced None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.732270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ab3e9-8dd6-4614-8624-a7bf32814ced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:28.732584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ab3e9-8dd6-4614-8624-a7bf32814ced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.734650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ab3e9-8dd6-4614-8624-a7bf32814ced None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.748178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 336/677] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:28.748708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55455129-b656-435a-8565-abbfef49f14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.749129 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab3e9-8dd6-4614-8624-a7bf32814ced None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.749974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55455129-b656-435a-8565-abbfef49f14f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.750331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55455129-b656-435a-8565-abbfef49f14f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.750699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55455129-b656-435a-8565-abbfef49f14f None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.751527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55455129-b656-435a-8565-abbfef49f14f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:28.751905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55455129-b656-435a-8565-abbfef49f14f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.753441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55455129-b656-435a-8565-abbfef49f14f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.763308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 342/678] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:28.768248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55455129-b656-435a-8565-abbfef49f14f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.854684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ab3e9-8dd6-4614-8624-a7bf32814ced None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.873960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55455129-b656-435a-8565-abbfef49f14f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.877747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:28.889476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab192-0852-4470-8719-239e0f4c68a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.890373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab192-0852-4470-8719-239e0f4c68a9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.890664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab192-0852-4470-8719-239e0f4c68a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.890947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ab192-0852-4470-8719-239e0f4c68a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.897601 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ab192-0852-4470-8719-239e0f4c68a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.899096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ab192-0852-4470-8719-239e0f4c68a9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f12ab192-0852-4470-8719-239e0f4c68a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:28.913911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:28.914982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:28.916038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:28.916038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:28.916038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:28.916038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:28.916038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:28.916038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:28.916038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:28.916038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:28.919886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 337/679] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:28.920734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab192-0852-4470-8719-239e0f4c68a9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.922010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626cc86-4582-4e3d-af0f-0952108168f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.923050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626cc86-4582-4e3d-af0f-0952108168f0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.923494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626cc86-4582-4e3d-af0f-0952108168f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.923916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626cc86-4582-4e3d-af0f-0952108168f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.938966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626cc86-4582-4e3d-af0f-0952108168f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6626cc86-4582-4e3d-af0f-0952108168f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:28.947360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:28.948494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:28.949498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:28.950729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 343/680] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:28.957222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626cc86-4582-4e3d-af0f-0952108168f0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.971960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.034812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ab192-0852-4470-8719-239e0f4c68a9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.064385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626cc86-4582-4e3d-af0f-0952108168f0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.069917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665fff3-815a-4946-a4fc-c3c72b74a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.070575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665fff3-815a-4946-a4fc-c3c72b74a516 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.070862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665fff3-815a-4946-a4fc-c3c72b74a516 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.071381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665fff3-815a-4946-a4fc-c3c72b74a516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.071988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665fff3-815a-4946-a4fc-c3c72b74a516 None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=079eeefcd0654dfe9cd4a9c51d239298) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:29.072305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665fff3-815a-4946-a4fc-c3c72b74a516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.074006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665fff3-815a-4946-a4fc-c3c72b74a516 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.094247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 338/681] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/role_assignments?user.id=079eeefcd0654dfe9cd4a9c51d239298&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:29.095245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665fff3-815a-4946-a4fc-c3c72b74a516 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.117253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44e7e9-da70-41fc-bfbb-ecc9600f905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.118087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44e7e9-da70-41fc-bfbb-ecc9600f905a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.118368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44e7e9-da70-41fc-bfbb-ecc9600f905a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.118641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44e7e9-da70-41fc-bfbb-ecc9600f905a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.132746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44e7e9-da70-41fc-bfbb-ecc9600f905a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.134423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c44e7e9-da70-41fc-bfbb-ecc9600f905a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.152687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-3c44e7e9-da70-41fc-bfbb-ecc9600f905a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:29.155560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:29.156610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:29.157739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:29.157739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:29.157739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:29.157739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:29.157739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 344/682] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:29.157739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44e7e9-da70-41fc-bfbb-ecc9600f905a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.227582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665fff3-815a-4946-a4fc-c3c72b74a516 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.229523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.274862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44e7e9-da70-41fc-bfbb-ecc9600f905a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.281923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d2a73-96d6-49fa-96cf-6ac0a02be7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.282700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d2a73-96d6-49fa-96cf-6ac0a02be7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.283082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d2a73-96d6-49fa-96cf-6ac0a02be7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.283446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d2a73-96d6-49fa-96cf-6ac0a02be7d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.285024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d2a73-96d6-49fa-96cf-6ac0a02be7d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:29.285414 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d2a73-96d6-49fa-96cf-6ac0a02be7d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.287528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d2a73-96d6-49fa-96cf-6ac0a02be7d2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.307607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 339/683] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:29.309650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d2a73-96d6-49fa-96cf-6ac0a02be7d2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.324694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00468b-54e1-4773-aeae-8b06f853f887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.325530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00468b-54e1-4773-aeae-8b06f853f887 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.325844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00468b-54e1-4773-aeae-8b06f853f887 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.326131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00468b-54e1-4773-aeae-8b06f853f887 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.327035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00468b-54e1-4773-aeae-8b06f853f887 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:29.327368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00468b-54e1-4773-aeae-8b06f853f887 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.328748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00468b-54e1-4773-aeae-8b06f853f887 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.339419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 345/684] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:29.340092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00468b-54e1-4773-aeae-8b06f853f887 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.426694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d2a73-96d6-49fa-96cf-6ac0a02be7d2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.433860 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.462454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00468b-54e1-4773-aeae-8b06f853f887 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.477963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5c596-a31c-4566-bd24-cdca96592890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.479121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5c596-a31c-4566-bd24-cdca96592890 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.479693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5c596-a31c-4566-bd24-cdca96592890 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.480134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5c596-a31c-4566-bd24-cdca96592890 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.481289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5c596-a31c-4566-bd24-cdca96592890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:29.481802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5c596-a31c-4566-bd24-cdca96592890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.483806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5c596-a31c-4566-bd24-cdca96592890 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.487807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.500800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa025-fa81-4a0c-a9ec-f0000b9b8f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.501783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa025-fa81-4a0c-a9ec-f0000b9b8f99 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.502125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 340/685] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:29.502456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa025-fa81-4a0c-a9ec-f0000b9b8f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.502884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fa025-fa81-4a0c-a9ec-f0000b9b8f99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.503335 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5c596-a31c-4566-bd24-cdca96592890 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.504036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fa025-fa81-4a0c-a9ec-f0000b9b8f99 None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=d7a0dbcea7ef4cdd9134f4c5a9cf5fb5) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:29.504497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fa025-fa81-4a0c-a9ec-f0000b9b8f99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.506324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fa025-fa81-4a0c-a9ec-f0000b9b8f99 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.517777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 346/686] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/role_assignments?user.id=d7a0dbcea7ef4cdd9134f4c5a9cf5fb5&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:29.519063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa025-fa81-4a0c-a9ec-f0000b9b8f99 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.663864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5c596-a31c-4566-bd24-cdca96592890 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.727532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934942-a6ed-4a7b-bbb5-3dc301069065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.728602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934942-a6ed-4a7b-bbb5-3dc301069065 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.729035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934942-a6ed-4a7b-bbb5-3dc301069065 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.730773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46934942-a6ed-4a7b-bbb5-3dc301069065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.741782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fa025-fa81-4a0c-a9ec-f0000b9b8f99 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.750908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46934942-a6ed-4a7b-bbb5-3dc301069065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.752667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46934942-a6ed-4a7b-bbb5-3dc301069065 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-46934942-a6ed-4a7b-bbb5-3dc301069065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:29.783784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:29.784979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:29.785895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:29.785895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:29.785895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:29.785895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:29.786547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 341/687] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:29.793382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934942-a6ed-4a7b-bbb5-3dc301069065 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.795694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5c3fb-c808-4f0d-a79a-1e865bfeec4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.797351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5c3fb-c808-4f0d-a79a-1e865bfeec4e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.797646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5c3fb-c808-4f0d-a79a-1e865bfeec4e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.797956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5c3fb-c808-4f0d-a79a-1e865bfeec4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.808722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5c3fb-c808-4f0d-a79a-1e865bfeec4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.810709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5c3fb-c808-4f0d-a79a-1e865bfeec4e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.822041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b3d5c3fb-c808-4f0d-a79a-1e865bfeec4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:29.833242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:29.837428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:29.838404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 347/688] 10.222.0.41 () {56 vars in 1093 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:29.842647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5c3fb-c808-4f0d-a79a-1e865bfeec4e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.910896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.921065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46934942-a6ed-4a7b-bbb5-3dc301069065 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.968481 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973ca90-3677-429a-b794-6b8349366127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.969148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973ca90-3677-429a-b794-6b8349366127 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.969433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973ca90-3677-429a-b794-6b8349366127 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.969789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973ca90-3677-429a-b794-6b8349366127 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.970992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973ca90-3677-429a-b794-6b8349366127 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:29.971316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973ca90-3677-429a-b794-6b8349366127 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.972947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973ca90-3677-429a-b794-6b8349366127 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.986338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 342/689] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:29.992361 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973ca90-3677-429a-b794-6b8349366127 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.023840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5c3fb-c808-4f0d-a79a-1e865bfeec4e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.090286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d812be2-b4cf-45f8-9cd3-8b9bbd59e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.090286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d812be2-b4cf-45f8-9cd3-8b9bbd59e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.090286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d812be2-b4cf-45f8-9cd3-8b9bbd59e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.090286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d812be2-b4cf-45f8-9cd3-8b9bbd59e8b3 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.090849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d812be2-b4cf-45f8-9cd3-8b9bbd59e8b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:30.091162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d812be2-b4cf-45f8-9cd3-8b9bbd59e8b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.092607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d812be2-b4cf-45f8-9cd3-8b9bbd59e8b3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.115102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.126992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 348/690] 10.222.0.41 () {56 vars in 1133 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:30.134085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d812be2-b4cf-45f8-9cd3-8b9bbd59e8b3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.156204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973ca90-3677-429a-b794-6b8349366127 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.222598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90913704-e2cf-49f6-b3fb-fbc79cabef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.223442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90913704-e2cf-49f6-b3fb-fbc79cabef2a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.223732 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90913704-e2cf-49f6-b3fb-fbc79cabef2a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.224013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90913704-e2cf-49f6-b3fb-fbc79cabef2a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.243780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90913704-e2cf-49f6-b3fb-fbc79cabef2a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.245574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90913704-e2cf-49f6-b3fb-fbc79cabef2a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.259447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d812be2-b4cf-45f8-9cd3-8b9bbd59e8b3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.267518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-90913704-e2cf-49f6-b3fb-fbc79cabef2a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:30.276162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:30.281700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:30.282805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 343/691] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:30.285827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90913704-e2cf-49f6-b3fb-fbc79cabef2a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.312824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4dbe9e-7ec8-4a5e-a890-b9e60b2f4ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.313489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dbe9e-7ec8-4a5e-a890-b9e60b2f4ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.313805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dbe9e-7ec8-4a5e-a890-b9e60b2f4ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.314091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4dbe9e-7ec8-4a5e-a890-b9e60b2f4ee3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.430652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dbe9e-7ec8-4a5e-a890-b9e60b2f4ee3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.432372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4dbe9e-7ec8-4a5e-a890-b9e60b2f4ee3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.549855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 349/692] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:30.551587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17195-8239-4e3e-b1a3-904d78010e3e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.552026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17195-8239-4e3e-b1a3-904d78010e3e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.552471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a17195-8239-4e3e-b1a3-904d78010e3e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.558175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90913704-e2cf-49f6-b3fb-fbc79cabef2a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.558729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 350/693] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:30.559803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17195-8239-4e3e-b1a3-904d78010e3e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.569803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.597164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd01da-c773-4173-a7cb-1a3fde892729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.598182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd01da-c773-4173-a7cb-1a3fde892729 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.598618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd01da-c773-4173-a7cb-1a3fde892729 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.599082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd01da-c773-4173-a7cb-1a3fde892729 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.600124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd01da-c773-4173-a7cb-1a3fde892729 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:30.600989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd01da-c773-4173-a7cb-1a3fde892729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.603754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd01da-c773-4173-a7cb-1a3fde892729 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.613109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.630006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 344/694] 10.222.0.41 () {56 vars in 1135 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:30.631628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54388-6bcc-4c6e-a51e-e6b9711081e7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.632206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54388-6bcc-4c6e-a51e-e6b9711081e7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.632741 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f54388-6bcc-4c6e-a51e-e6b9711081e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.653232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-73f54388-6bcc-4c6e-a51e-e6b9711081e7 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:30.654864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-73f54388-6bcc-4c6e-a51e-e6b9711081e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:30.670438 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a17195-8239-4e3e-b1a3-904d78010e3e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.707082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea192d-844d-4455-a152-ae1781e564a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.707974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea192d-844d-4455-a152-ae1781e564a2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.708263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea192d-844d-4455-a152-ae1781e564a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.708535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea192d-844d-4455-a152-ae1781e564a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.719925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea192d-844d-4455-a152-ae1781e564a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.721370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea192d-844d-4455-a152-ae1781e564a2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.734792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 345/695] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:30.735905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f54388-6bcc-4c6e-a51e-e6b9711081e7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b5ea192d-844d-4455-a152-ae1781e564a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:30.747780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:30.748714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:30.749686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:30.749686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:30.749686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:30.749686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:30.749686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 351/696] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:30.754624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea192d-844d-4455-a152-ae1781e564a2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.829755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.846574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f54388-6bcc-4c6e-a51e-e6b9711081e7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.873936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea192d-844d-4455-a152-ae1781e564a2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.875689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.885586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902adbe6-6dce-4a4b-a74c-422fc2a58b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.886453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902adbe6-6dce-4a4b-a74c-422fc2a58b44 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.887281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902adbe6-6dce-4a4b-a74c-422fc2a58b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.887512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902adbe6-6dce-4a4b-a74c-422fc2a58b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.910714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e99f65-61cf-4cf0-b8cd-03f92aa00892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.911382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99f65-61cf-4cf0-b8cd-03f92aa00892 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.911667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99f65-61cf-4cf0-b8cd-03f92aa00892 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.911946 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e99f65-61cf-4cf0-b8cd-03f92aa00892 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.912659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e99f65-61cf-4cf0-b8cd-03f92aa00892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:30.912964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e99f65-61cf-4cf0-b8cd-03f92aa00892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.914627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e99f65-61cf-4cf0-b8cd-03f92aa00892 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.931781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 352/697] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:30.932806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e99f65-61cf-4cf0-b8cd-03f92aa00892 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.967357 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902adbe6-6dce-4a4b-a74c-422fc2a58b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.969654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902adbe6-6dce-4a4b-a74c-422fc2a58b44 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.039999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e99f65-61cf-4cf0-b8cd-03f92aa00892 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.059183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.085904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5108834-8514-40f2-8a9f-b66262500820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.086912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108834-8514-40f2-8a9f-b66262500820 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.087372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108834-8514-40f2-8a9f-b66262500820 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.088106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 346/698] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:31.088258 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5108834-8514-40f2-8a9f-b66262500820 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.089132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5108834-8514-40f2-8a9f-b66262500820 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.089875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902adbe6-6dce-4a4b-a74c-422fc2a58b44 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.090981 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5108834-8514-40f2-8a9f-b66262500820 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f5108834-8514-40f2-8a9f-b66262500820 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:31.107653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:31.108907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:31.109881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:31.116812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 353/699] 10.222.0.41 () {56 vars in 1129 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:31.117969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5108834-8514-40f2-8a9f-b66262500820 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.119768 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.200573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902adbe6-6dce-4a4b-a74c-422fc2a58b44 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.226699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5108834-8514-40f2-8a9f-b66262500820 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.238460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51f94c-82cc-4859-a0ee-657cd79b4cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.239405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51f94c-82cc-4859-a0ee-657cd79b4cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.239697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51f94c-82cc-4859-a0ee-657cd79b4cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.239978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51f94c-82cc-4859-a0ee-657cd79b4cc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.247591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51f94c-82cc-4859-a0ee-657cd79b4cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.249109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51f94c-82cc-4859-a0ee-657cd79b4cc0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-fa51f94c-82cc-4859-a0ee-657cd79b4cc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:31.264510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:31.265655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:31.266719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:31.266719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:31.266719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:31.266719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:31.266719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:31.266719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:31.266719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:31.266719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:31.267175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4d97c-c774-4d72-90a0-5301c8904f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.268102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d97c-c774-4d72-90a0-5301c8904f2c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.268595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d97c-c774-4d72-90a0-5301c8904f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.268995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4d97c-c774-4d72-90a0-5301c8904f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.270456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 347/700] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:31.271308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51f94c-82cc-4859-a0ee-657cd79b4cc0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.281652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4d97c-c774-4d72-90a0-5301c8904f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.283460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4d97c-c774-4d72-90a0-5301c8904f2c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-12b4d97c-c774-4d72-90a0-5301c8904f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:31.301745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:31.302820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:31.303741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:31.303741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:31.303741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:31.303741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:31.305691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 354/701] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:31.306673 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4d97c-c774-4d72-90a0-5301c8904f2c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.343586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.370255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.387186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51f94c-82cc-4859-a0ee-657cd79b4cc0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.416484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4d97c-c774-4d72-90a0-5301c8904f2c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.424734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea215c0e-8bd4-4dd8-a87a-83608e4ba4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.425482 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215c0e-8bd4-4dd8-a87a-83608e4ba4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.425893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215c0e-8bd4-4dd8-a87a-83608e4ba4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.426242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea215c0e-8bd4-4dd8-a87a-83608e4ba4a3 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.427128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea215c0e-8bd4-4dd8-a87a-83608e4ba4a3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:31.427526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea215c0e-8bd4-4dd8-a87a-83608e4ba4a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.429093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea215c0e-8bd4-4dd8-a87a-83608e4ba4a3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.439010 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 348/702] 10.222.0.41 () {56 vars in 1124 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:31.439010 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea215c0e-8bd4-4dd8-a87a-83608e4ba4a3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.458593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec482c-f26d-404f-8d29-3f5698f45391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.459484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec482c-f26d-404f-8d29-3f5698f45391 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.459939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec482c-f26d-404f-8d29-3f5698f45391 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.460357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec482c-f26d-404f-8d29-3f5698f45391 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.461373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec482c-f26d-404f-8d29-3f5698f45391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:31.461851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec482c-f26d-404f-8d29-3f5698f45391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.463464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec482c-f26d-404f-8d29-3f5698f45391 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.477040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 355/703] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:31.478190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec482c-f26d-404f-8d29-3f5698f45391 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.555295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea215c0e-8bd4-4dd8-a87a-83608e4ba4a3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.581599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.589499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec482c-f26d-404f-8d29-3f5698f45391 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.593579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ddaa0-9b43-47b8-a0c3-609f46727540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.597330 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ddaa0-9b43-47b8-a0c3-609f46727540 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.597330 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ddaa0-9b43-47b8-a0c3-609f46727540 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.597330 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ddaa0-9b43-47b8-a0c3-609f46727540 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.597330 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ddaa0-9b43-47b8-a0c3-609f46727540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:31.597330 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ddaa0-9b43-47b8-a0c3-609f46727540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.597784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ddaa0-9b43-47b8-a0c3-609f46727540 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.615865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 349/704] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:31.618055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ddaa0-9b43-47b8-a0c3-609f46727540 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.628702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91936b-dfb5-4d14-ad0a-9220225428d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.629611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91936b-dfb5-4d14-ad0a-9220225428d3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.630141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91936b-dfb5-4d14-ad0a-9220225428d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.630592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91936b-dfb5-4d14-ad0a-9220225428d3 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.631492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91936b-dfb5-4d14-ad0a-9220225428d3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:31.631880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.633054 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91936b-dfb5-4d14-ad0a-9220225428d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.634706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91936b-dfb5-4d14-ad0a-9220225428d3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.649803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 356/705] 10.222.0.41 () {56 vars in 1124 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:31.651045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91936b-dfb5-4d14-ad0a-9220225428d3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.734243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ddaa0-9b43-47b8-a0c3-609f46727540 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.773818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce2257-375f-4898-a751-6d378b3544dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.774441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce2257-375f-4898-a751-6d378b3544dd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.774792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce2257-375f-4898-a751-6d378b3544dd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.775078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce2257-375f-4898-a751-6d378b3544dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.776083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce2257-375f-4898-a751-6d378b3544dd None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=a1e4a66515654e1f9f7452740ff4ce58) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:31.776408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce2257-375f-4898-a751-6d378b3544dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.778234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce2257-375f-4898-a751-6d378b3544dd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.780432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91936b-dfb5-4d14-ad0a-9220225428d3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.793964 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 350/706] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/role_assignments?user.id=a1e4a66515654e1f9f7452740ff4ce58&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:31.795612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a41ca-d3dd-4745-97ac-da3f99c9cb41 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.795912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a41ca-d3dd-4745-97ac-da3f99c9cb41 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.796859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a41ca-d3dd-4745-97ac-da3f99c9cb41 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.798702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 351/707] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:31.804428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c128d46-31ee-4763-8bbd-0aa1e80f0318 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.804759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c128d46-31ee-4763-8bbd-0aa1e80f0318 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.804999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c128d46-31ee-4763-8bbd-0aa1e80f0318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.822353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4c0bb-12c9-42ee-b42d-e93526f5f3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.823719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c0bb-12c9-42ee-b42d-e93526f5f3aa None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.824234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c0bb-12c9-42ee-b42d-e93526f5f3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.824734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4c0bb-12c9-42ee-b42d-e93526f5f3aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.835453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5c128d46-31ee-4763-8bbd-0aa1e80f0318 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:31.838516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4c0bb-12c9-42ee-b42d-e93526f5f3aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.840479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4c0bb-12c9-42ee-b42d-e93526f5f3aa None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.842349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5c128d46-31ee-4763-8bbd-0aa1e80f0318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-aef4c0bb-12c9-42ee-b42d-e93526f5f3aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:31.868451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:31.869406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:31.870599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:31.870599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:31.870599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:31.870599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:31.870599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:31.870599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:31.870599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:31.870599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:31.882704 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 357/708] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:31.889626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4c0bb-12c9-42ee-b42d-e93526f5f3aa None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.935776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.016224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 352/709] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:32.053319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c128d46-31ee-4763-8bbd-0aa1e80f0318 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.070009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.082872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4c0bb-12c9-42ee-b42d-e93526f5f3aa None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.155391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822779e-9980-4617-8b4f-14d043a62049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.156595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822779e-9980-4617-8b4f-14d043a62049 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.156880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822779e-9980-4617-8b4f-14d043a62049 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.157154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822779e-9980-4617-8b4f-14d043a62049 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.157968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822779e-9980-4617-8b4f-14d043a62049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:32.158278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822779e-9980-4617-8b4f-14d043a62049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.160079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822779e-9980-4617-8b4f-14d043a62049 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.173214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 358/710] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:32.178737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822779e-9980-4617-8b4f-14d043a62049 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.233207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c128d46-31ee-4763-8bbd-0aa1e80f0318 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.277331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.280845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3015737-138b-46b9-ae74-f9ae7fb7824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.282053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3015737-138b-46b9-ae74-f9ae7fb7824c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.282344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3015737-138b-46b9-ae74-f9ae7fb7824c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.282904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3015737-138b-46b9-ae74-f9ae7fb7824c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.297432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3015737-138b-46b9-ae74-f9ae7fb7824c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.299486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3015737-138b-46b9-ae74-f9ae7fb7824c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.300434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822779e-9980-4617-8b4f-14d043a62049 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c3015737-138b-46b9-ae74-f9ae7fb7824c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:32.322142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:32.323120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:32.324016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:32.324016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:32.324016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:32.324016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:32.324480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 353/711] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:32.326204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d98f9-136b-4739-8c7b-6d0e9122c72a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.326624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d98f9-136b-4739-8c7b-6d0e9122c72a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.326910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d98f9-136b-4739-8c7b-6d0e9122c72a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.329455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 354/712] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:32.333705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d98f9-136b-4739-8c7b-6d0e9122c72a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.342470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175b19e-6b72-483d-81f3-02d06937a0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.343249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b19e-6b72-483d-81f3-02d06937a0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.343543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b19e-6b72-483d-81f3-02d06937a0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.343827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175b19e-6b72-483d-81f3-02d06937a0d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.344667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175b19e-6b72-483d-81f3-02d06937a0d0 None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=af5ebb39734144418fe35f9f0a679145) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:32.344987 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175b19e-6b72-483d-81f3-02d06937a0d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.347107 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175b19e-6b72-483d-81f3-02d06937a0d0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.361712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 359/713] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/role_assignments?user.id=af5ebb39734144418fe35f9f0a679145&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:32.361712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f27c5-5a3a-4771-b080-9fc0daafb64e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.361712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f27c5-5a3a-4771-b080-9fc0daafb64e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.361712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f27c5-5a3a-4771-b080-9fc0daafb64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.391934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9b8f27c5-5a3a-4771-b080-9fc0daafb64e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:32.393243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9b8f27c5-5a3a-4771-b080-9fc0daafb64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:32.454029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.526350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 360/714] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:32.536077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d98f9-136b-4739-8c7b-6d0e9122c72a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.558438 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f27c5-5a3a-4771-b080-9fc0daafb64e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.585633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142278fc-20c8-49f9-9efe-965f9f53c60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.587080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142278fc-20c8-49f9-9efe-965f9f53c60f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.587930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142278fc-20c8-49f9-9efe-965f9f53c60f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.588670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142278fc-20c8-49f9-9efe-965f9f53c60f None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.589863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142278fc-20c8-49f9-9efe-965f9f53c60f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:32.590791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142278fc-20c8-49f9-9efe-965f9f53c60f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.592782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142278fc-20c8-49f9-9efe-965f9f53c60f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.607960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 355/715] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:32.617089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142278fc-20c8-49f9-9efe-965f9f53c60f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.652479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.695126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f27c5-5a3a-4771-b080-9fc0daafb64e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.742041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142278fc-20c8-49f9-9efe-965f9f53c60f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.748575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804d9f3-672d-4e2d-b324-b8e0ec80ce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.750427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804d9f3-672d-4e2d-b324-b8e0ec80ce89 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.750722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804d9f3-672d-4e2d-b324-b8e0ec80ce89 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.751003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804d9f3-672d-4e2d-b324-b8e0ec80ce89 None admin] PATH_INFO: `/v3/services/network` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.751663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804d9f3-672d-4e2d-b324-b8e0ec80ce89 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.753145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804d9f3-672d-4e2d-b324-b8e0ec80ce89 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.761564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d804d9f3-672d-4e2d-b324-b8e0ec80ce89 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:32.765620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:32.766594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:32.767387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 361/716] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:32.773481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804d9f3-672d-4e2d-b324-b8e0ec80ce89 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.789584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ef626-2a65-482d-9b92-315b05a32ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.790322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ef626-2a65-482d-9b92-315b05a32ce2 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.790612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ef626-2a65-482d-9b92-315b05a32ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.791085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ef626-2a65-482d-9b92-315b05a32ce2 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.792032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ef626-2a65-482d-9b92-315b05a32ce2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.794523 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ef626-2a65-482d-9b92-315b05a32ce2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.881114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 356/717] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:24:32 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:32.898549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804d9f3-672d-4e2d-b324-b8e0ec80ce89 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.941558 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d725be9-a131-4fba-80a0-66da45fa9247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.942522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d725be9-a131-4fba-80a0-66da45fa9247 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.942951 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d725be9-a131-4fba-80a0-66da45fa9247 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.943429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d725be9-a131-4fba-80a0-66da45fa9247 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.944300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d725be9-a131-4fba-80a0-66da45fa9247 None admin] RBAC: Adding query filter params (name=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:32.944816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d725be9-a131-4fba-80a0-66da45fa9247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.946753 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d725be9-a131-4fba-80a0-66da45fa9247 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.949598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.953452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 362/718] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:32.959329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ef626-2a65-482d-9b92-315b05a32ce2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.105124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ef626-2a65-482d-9b92-315b05a32ce2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.144455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1781d-f0c9-4b47-afd9-838adf467317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.145177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1781d-f0c9-4b47-afd9-838adf467317 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.145460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1781d-f0c9-4b47-afd9-838adf467317 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.145792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1781d-f0c9-4b47-afd9-838adf467317 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.146499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1781d-f0c9-4b47-afd9-838adf467317 None admin] RBAC: Adding query filter params (type=network) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:33.146805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1781d-f0c9-4b47-afd9-838adf467317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:33.149114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1781d-f0c9-4b47-afd9-838adf467317 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:33.157029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 357/719] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.260685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad611b-eeb8-4517-9352-0638aeb7b245 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.261207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad611b-eeb8-4517-9352-0638aeb7b245 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.261292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad611b-eeb8-4517-9352-0638aeb7b245 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.262880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 363/720] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:34.268907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a6231-3170-4abb-83f4-f73376b2afba None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.269348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a6231-3170-4abb-83f4-f73376b2afba None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.269468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a6231-3170-4abb-83f4-f73376b2afba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.294704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6c9a6231-3170-4abb-83f4-f73376b2afba None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:34.295898 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6c9a6231-3170-4abb-83f4-f73376b2afba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:34.339098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.351844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc6b0-5ba7-4f8d-9d0f-92fd73640a12 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.352460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc6b0-5ba7-4f8d-9d0f-92fd73640a12 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.352938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbc6b0-5ba7-4f8d-9d0f-92fd73640a12 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.354802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 364/721] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:34.360653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735ad26-543f-4b06-b85a-a3e7997f9585 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.361217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735ad26-543f-4b06-b85a-a3e7997f9585 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.361727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735ad26-543f-4b06-b85a-a3e7997f9585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.386605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1735ad26-543f-4b06-b85a-a3e7997f9585 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:34.387874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1735ad26-543f-4b06-b85a-a3e7997f9585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:34.393332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 358/722] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:34.463239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a6231-3170-4abb-83f4-f73376b2afba None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.480540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 365/723] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:34.522023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735ad26-543f-4b06-b85a-a3e7997f9585 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.583907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a6231-3170-4abb-83f4-f73376b2afba None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.636082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9de16-74c9-4661-8921-624638f8738d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.636861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9de16-74c9-4661-8921-624638f8738d None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.637150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9de16-74c9-4661-8921-624638f8738d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.637433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9de16-74c9-4661-8921-624638f8738d None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.638236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9de16-74c9-4661-8921-624638f8738d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.639668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9de16-74c9-4661-8921-624638f8738d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.751672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 359/724] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:24:34 2022] POST /identity/v3/services => generated 251 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:24:34.754609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735ad26-543f-4b06-b85a-a3e7997f9585 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.788028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.820062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ba3d3-af58-480d-b87b-cf93c95ce50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.820963 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ba3d3-af58-480d-b87b-cf93c95ce50b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.821260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ba3d3-af58-480d-b87b-cf93c95ce50b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.821539 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ba3d3-af58-480d-b87b-cf93c95ce50b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.836871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ba3d3-af58-480d-b87b-cf93c95ce50b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fe6ba3d3-af58-480d-b87b-cf93c95ce50b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:34.845290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:34.846308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:34.847109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 366/725] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:34.852585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9de16-74c9-4661-8921-624638f8738d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.903297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.012650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9de16-74c9-4661-8921-624638f8738d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.048190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64f1a-8cc5-48e8-9def-397535689ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.048868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64f1a-8cc5-48e8-9def-397535689ffa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.049154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64f1a-8cc5-48e8-9def-397535689ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.049433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64f1a-8cc5-48e8-9def-397535689ffa None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.050215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f64f1a-8cc5-48e8-9def-397535689ffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.050525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f64f1a-8cc5-48e8-9def-397535689ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.051893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f64f1a-8cc5-48e8-9def-397535689ffa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.060859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 360/726] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.066836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ba3d3-af58-480d-b87b-cf93c95ce50b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.179266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ba3d3-af58-480d-b87b-cf93c95ce50b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.218171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54b674-b759-4077-8ba1-c5c6234ef7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.219053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b674-b759-4077-8ba1-c5c6234ef7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.219346 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b674-b759-4077-8ba1-c5c6234ef7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.219630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54b674-b759-4077-8ba1-c5c6234ef7b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.231707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54b674-b759-4077-8ba1-c5c6234ef7b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.233199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54b674-b759-4077-8ba1-c5c6234ef7b1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7c54b674-b759-4077-8ba1-c5c6234ef7b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:35.253638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:35.254603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:35.255469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:35.255469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:35.255469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:35.255469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:35.259758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 367/727] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:35.261220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64f1a-8cc5-48e8-9def-397535689ffa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.383399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.402567 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64f1a-8cc5-48e8-9def-397535689ffa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.429030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece1e1-21e4-4656-bc64-3b279b1ff410 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.430017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece1e1-21e4-4656-bc64-3b279b1ff410 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.430485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbece1e1-21e4-4656-bc64-3b279b1ff410 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.432038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 368/728] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:35.438931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2176-aa74-46df-8c1a-51092d83d674 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.439226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2176-aa74-46df-8c1a-51092d83d674 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.439512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb2176-aa74-46df-8c1a-51092d83d674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.461827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c3cb2176-aa74-46df-8c1a-51092d83d674 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:35.463414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c3cb2176-aa74-46df-8c1a-51092d83d674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:35.474746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8bc27-0b96-4cf8-817f-4340fa7bbada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.475764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8bc27-0b96-4cf8-817f-4340fa7bbada None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.476256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8bc27-0b96-4cf8-817f-4340fa7bbada None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.476738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8bc27-0b96-4cf8-817f-4340fa7bbada None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.477856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8bc27-0b96-4cf8-817f-4340fa7bbada None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.480137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8bc27-0b96-4cf8-817f-4340fa7bbada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.481776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8bc27-0b96-4cf8-817f-4340fa7bbada None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.504723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 361/729] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.510112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8bc27-0b96-4cf8-817f-4340fa7bbada None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.526202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.607362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 369/730] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:35.640192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb2176-aa74-46df-8c1a-51092d83d674 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.661231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8bc27-0b96-4cf8-817f-4340fa7bbada None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.777328 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489645aa-dfb6-4be6-a3bf-a0a0ee333a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.778535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489645aa-dfb6-4be6-a3bf-a0a0ee333a36 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.779048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489645aa-dfb6-4be6-a3bf-a0a0ee333a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.779547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489645aa-dfb6-4be6-a3bf-a0a0ee333a36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.788485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489645aa-dfb6-4be6-a3bf-a0a0ee333a36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.790371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489645aa-dfb6-4be6-a3bf-a0a0ee333a36 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-489645aa-dfb6-4be6-a3bf-a0a0ee333a36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:35.806991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:35.807960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:35.808873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:35.808873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:35.808873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:35.808873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:35.808873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:35.808873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:35.808873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:35.808873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:35.808873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:35.808873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:35.811523 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 362/731] 10.222.0.41 () {56 vars in 1093 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:35.813345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963789d0-e5d8-41b9-88d8-8851becc173f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.813862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963789d0-e5d8-41b9-88d8-8851becc173f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.814346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963789d0-e5d8-41b9-88d8-8851becc173f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.816632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 363/732] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:35.817837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963789d0-e5d8-41b9-88d8-8851becc173f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.829315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.831268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb2176-aa74-46df-8c1a-51092d83d674 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.870997 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e00ab-2664-4ba5-9c47-a817f8a1cece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.872225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e00ab-2664-4ba5-9c47-a817f8a1cece None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.872716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e00ab-2664-4ba5-9c47-a817f8a1cece None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.873231 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e00ab-2664-4ba5-9c47-a817f8a1cece None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.887835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e00ab-2664-4ba5-9c47-a817f8a1cece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-fa6e00ab-2664-4ba5-9c47-a817f8a1cece None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:35.896123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:35.897200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:35.898337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:35.900944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 370/733] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:35.902466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbda5a8-acbb-4439-8fda-dadc688579ff None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.902890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbda5a8-acbb-4439-8fda-dadc688579ff None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.903352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbda5a8-acbb-4439-8fda-dadc688579ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.923258 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fdbda5a8-acbb-4439-8fda-dadc688579ff None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:35.924583 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fdbda5a8-acbb-4439-8fda-dadc688579ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:35.949986 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.954939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963789d0-e5d8-41b9-88d8-8851becc173f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.000664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 371/734] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:36.001780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbda5a8-acbb-4439-8fda-dadc688579ff None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.003917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8082e1-7184-4fc8-9b7d-1b746cde78d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.005089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8082e1-7184-4fc8-9b7d-1b746cde78d2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.006095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8082e1-7184-4fc8-9b7d-1b746cde78d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.006323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8082e1-7184-4fc8-9b7d-1b746cde78d2 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.007174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8082e1-7184-4fc8-9b7d-1b746cde78d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:36.007488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8082e1-7184-4fc8-9b7d-1b746cde78d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.008926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8082e1-7184-4fc8-9b7d-1b746cde78d2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.027983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 364/735] 10.222.0.41 () {56 vars in 1133 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:36.034969 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8082e1-7184-4fc8-9b7d-1b746cde78d2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.124977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.146939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbda5a8-acbb-4439-8fda-dadc688579ff None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.173840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8082e1-7184-4fc8-9b7d-1b746cde78d2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.183452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec193-4f1c-483c-9efe-7bc813ca2b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.184183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec193-4f1c-483c-9efe-7bc813ca2b93 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.184477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec193-4f1c-483c-9efe-7bc813ca2b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.184758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eec193-4f1c-483c-9efe-7bc813ca2b93 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.185566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eec193-4f1c-483c-9efe-7bc813ca2b93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:36.185918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eec193-4f1c-483c-9efe-7bc813ca2b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.187424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eec193-4f1c-483c-9efe-7bc813ca2b93 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.196099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 372/736] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:36.196966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec193-4f1c-483c-9efe-7bc813ca2b93 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.213456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2a314-a878-4c2d-8575-6fcd97016e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.214296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2a314-a878-4c2d-8575-6fcd97016e8d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.214583 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2a314-a878-4c2d-8575-6fcd97016e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.214866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2a314-a878-4c2d-8575-6fcd97016e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.221100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.226384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2a314-a878-4c2d-8575-6fcd97016e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.227887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2a314-a878-4c2d-8575-6fcd97016e8d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e7e2a314-a878-4c2d-8575-6fcd97016e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:36.247708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:36.248725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:36.250260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:36.250260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:36.250260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:36.250260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:36.250260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 365/737] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:36.250624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91201876-ac60-47d3-a0e7-3253b2776436 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.250895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91201876-ac60-47d3-a0e7-3253b2776436 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.251175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91201876-ac60-47d3-a0e7-3253b2776436 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.252681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 366/738] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:36.253122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91201876-ac60-47d3-a0e7-3253b2776436 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.311685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eec193-4f1c-483c-9efe-7bc813ca2b93 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.345351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fa20a-902f-4f99-8e76-3866a8e5b025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.346181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fa20a-902f-4f99-8e76-3866a8e5b025 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.346464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fa20a-902f-4f99-8e76-3866a8e5b025 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.346741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fa20a-902f-4f99-8e76-3866a8e5b025 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.356692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fa20a-902f-4f99-8e76-3866a8e5b025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:36.364270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91201876-ac60-47d3-a0e7-3253b2776436 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a20fa20a-902f-4f99-8e76-3866a8e5b025 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:36.364910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:36.365883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:36.366718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 373/739] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:36.367687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fa20a-902f-4f99-8e76-3866a8e5b025 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.388087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.410424 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45878d-5ea4-41e7-985c-b32db2d42af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.411212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45878d-5ea4-41e7-985c-b32db2d42af1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.411491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45878d-5ea4-41e7-985c-b32db2d42af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.411761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45878d-5ea4-41e7-985c-b32db2d42af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.423489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45878d-5ea4-41e7-985c-b32db2d42af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.424885 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45878d-5ea4-41e7-985c-b32db2d42af1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1b45878d-5ea4-41e7-985c-b32db2d42af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:36.441938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:36.443012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:36.443945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:36.443945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:36.443945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:36.443945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:36.443945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 367/740] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:36.444598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43c1f3-b869-4982-94a7-42c1266cc92b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.444598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43c1f3-b869-4982-94a7-42c1266cc92b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.444854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c43c1f3-b869-4982-94a7-42c1266cc92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.456301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.461194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5c43c1f3-b869-4982-94a7-42c1266cc92b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:36.462406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5c43c1f3-b869-4982-94a7-42c1266cc92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:36.476829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fa20a-902f-4f99-8e76-3866a8e5b025 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.510799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe4a0-cdd2-4865-87a0-4fc59b04b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.511652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe4a0-cdd2-4865-87a0-4fc59b04b864 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.512139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe4a0-cdd2-4865-87a0-4fc59b04b864 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.512439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fe4a0-cdd2-4865-87a0-4fc59b04b864 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.513530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fe4a0-cdd2-4865-87a0-4fc59b04b864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:36.514058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fe4a0-cdd2-4865-87a0-4fc59b04b864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.515966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360fe4a0-cdd2-4865-87a0-4fc59b04b864 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.527772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 374/741] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:36.528564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe4a0-cdd2-4865-87a0-4fc59b04b864 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.535870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 368/742] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:36.537443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43c1f3-b869-4982-94a7-42c1266cc92b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.629236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fe4a0-cdd2-4865-87a0-4fc59b04b864 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.648361 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.651731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c43c1f3-b869-4982-94a7-42c1266cc92b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.666266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652c180-cc6c-48da-bff9-ab8773ad3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.667048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652c180-cc6c-48da-bff9-ab8773ad3d29 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.667341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652c180-cc6c-48da-bff9-ab8773ad3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.667623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652c180-cc6c-48da-bff9-ab8773ad3d29 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.668368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652c180-cc6c-48da-bff9-ab8773ad3d29 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:36.668682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652c180-cc6c-48da-bff9-ab8773ad3d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.670068 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652c180-cc6c-48da-bff9-ab8773ad3d29 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.678281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 375/743] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:36.679071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652c180-cc6c-48da-bff9-ab8773ad3d29 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.681656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.693265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f48e8-7b99-47a5-bb70-76da04a60f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.694110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f48e8-7b99-47a5-bb70-76da04a60f00 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.694465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f48e8-7b99-47a5-bb70-76da04a60f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.694728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f48e8-7b99-47a5-bb70-76da04a60f00 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.695447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f48e8-7b99-47a5-bb70-76da04a60f00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:36.695753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f48e8-7b99-47a5-bb70-76da04a60f00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.697118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65f48e8-7b99-47a5-bb70-76da04a60f00 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.708555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 369/744] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:36.709250 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f48e8-7b99-47a5-bb70-76da04a60f00 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.799539 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652c180-cc6c-48da-bff9-ab8773ad3d29 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.812385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f48e8-7b99-47a5-bb70-76da04a60f00 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.833209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff94c-3246-4a73-bff8-a8b488d4d476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.834022 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff94c-3246-4a73-bff8-a8b488d4d476 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.834305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff94c-3246-4a73-bff8-a8b488d4d476 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.834578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff94c-3246-4a73-bff8-a8b488d4d476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.841173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ff94c-3246-4a73-bff8-a8b488d4d476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.842658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ff94c-3246-4a73-bff8-a8b488d4d476 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.850261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d84404-44f5-4431-80a1-a09b5ec71b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.851149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84404-44f5-4431-80a1-a09b5ec71b90 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.851614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84404-44f5-4431-80a1-a09b5ec71b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.852071 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84404-44f5-4431-80a1-a09b5ec71b90 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.852959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d84404-44f5-4431-80a1-a09b5ec71b90 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.854556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d84404-44f5-4431-80a1-a09b5ec71b90 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-473ff94c-3246-4a73-bff8-a8b488d4d476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:36.857341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:36.858332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:36.859447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:36.859447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:36.859447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:36.859447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:36.859447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:36.859447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:36.859447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:36.859447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:36.863145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 376/745] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:36.863821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff94c-3246-4a73-bff8-a8b488d4d476 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.919100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 370/746] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:24:36 2022] POST /identity/v3/services => generated 240 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:36.920022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d84404-44f5-4431-80a1-a09b5ec71b90 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.935474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.950598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.991634 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff94c-3246-4a73-bff8-a8b488d4d476 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.043099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff78e-55f7-444e-befe-550e2d9d8dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.044206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff78e-55f7-444e-befe-550e2d9d8dfc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.044641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff78e-55f7-444e-befe-550e2d9d8dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.045180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ff78e-55f7-444e-befe-550e2d9d8dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.057728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ff78e-55f7-444e-befe-550e2d9d8dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.059597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ff78e-55f7-444e-befe-550e2d9d8dfc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.078593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d84404-44f5-4431-80a1-a09b5ec71b90 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-296ff78e-55f7-444e-befe-550e2d9d8dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:37.082242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:37.083386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:37.084462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:37.084462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:37.084462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:37.084462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:37.090930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 377/747] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:37.092890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff78e-55f7-444e-befe-550e2d9d8dfc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.119737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccc4e7-7311-4f84-b393-ffec1d3baeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.120797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccc4e7-7311-4f84-b393-ffec1d3baeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.121078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccc4e7-7311-4f84-b393-ffec1d3baeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.121351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccc4e7-7311-4f84-b393-ffec1d3baeb9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.129541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccc4e7-7311-4f84-b393-ffec1d3baeb9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.131033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccc4e7-7311-4f84-b393-ffec1d3baeb9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-1cccc4e7-7311-4f84-b393-ffec1d3baeb9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:37.146005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:37.147132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:37.148050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:37.148050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:37.148050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:37.148050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:37.148050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:37.148050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:37.148050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:37.148050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:37.148050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:37.148050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:37.150390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 371/748] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:37.150390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccc4e7-7311-4f84-b393-ffec1d3baeb9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.225709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ff78e-55f7-444e-befe-550e2d9d8dfc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.238855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.260456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.269369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52cd8b-3d99-4d21-a639-e59341df2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.270585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52cd8b-3d99-4d21-a639-e59341df2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.271215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52cd8b-3d99-4d21-a639-e59341df2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.271862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52cd8b-3d99-4d21-a639-e59341df2ae4 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.273207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52cd8b-3d99-4d21-a639-e59341df2ae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.273953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52cd8b-3d99-4d21-a639-e59341df2ae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.276124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52cd8b-3d99-4d21-a639-e59341df2ae4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.282405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccc4e7-7311-4f84-b393-ffec1d3baeb9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.292605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 378/749] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.294198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52cd8b-3d99-4d21-a639-e59341df2ae4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.323932 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772f528-1d24-48f4-a800-b0fac571c718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.324737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772f528-1d24-48f4-a800-b0fac571c718 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.325230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772f528-1d24-48f4-a800-b0fac571c718 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.325650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772f528-1d24-48f4-a800-b0fac571c718 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.326846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772f528-1d24-48f4-a800-b0fac571c718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.327294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772f528-1d24-48f4-a800-b0fac571c718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.329321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772f528-1d24-48f4-a800-b0fac571c718 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.343447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 372/750] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.344687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772f528-1d24-48f4-a800-b0fac571c718 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.414777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52cd8b-3d99-4d21-a639-e59341df2ae4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.451514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a691a-f5b0-454c-a002-99f69ce0c559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.452257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a691a-f5b0-454c-a002-99f69ce0c559 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.452543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a691a-f5b0-454c-a002-99f69ce0c559 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.452824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851a691a-f5b0-454c-a002-99f69ce0c559 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.453211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772f528-1d24-48f4-a800-b0fac571c718 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.453750 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a691a-f5b0-454c-a002-99f69ce0c559 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.454001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a691a-f5b0-454c-a002-99f69ce0c559 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.455428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851a691a-f5b0-454c-a002-99f69ce0c559 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.477484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 379/751] 10.222.0.41 () {56 vars in 1135 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.477484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a691a-f5b0-454c-a002-99f69ce0c559 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.494780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c683ad-5f72-48e7-aefa-2e53ea8245ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.495929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c683ad-5f72-48e7-aefa-2e53ea8245ec None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.496214 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c683ad-5f72-48e7-aefa-2e53ea8245ec None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.496504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c683ad-5f72-48e7-aefa-2e53ea8245ec None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/a1e4a66515654e1f9f7452740ff4ce58/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.498594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c683ad-5f72-48e7-aefa-2e53ea8245ec None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=a1e4a66515654e1f9f7452740ff4ce58, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.500095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c683ad-5f72-48e7-aefa-2e53ea8245ec None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.510796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.579885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851a691a-f5b0-454c-a002-99f69ce0c559 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.582399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.587856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 373/752] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:24:37 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/a1e4a66515654e1f9f7452740ff4ce58/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:37.589318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aaea6-b532-46be-a8bc-dfc4daf57e79 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.589612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aaea6-b532-46be-a8bc-dfc4daf57e79 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.589915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aaea6-b532-46be-a8bc-dfc4daf57e79 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.596014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 374/753] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:37.596014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aaea6-b532-46be-a8bc-dfc4daf57e79 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.633514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf3097-983d-4957-943e-1bef176ed6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.635222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf3097-983d-4957-943e-1bef176ed6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.635696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf3097-983d-4957-943e-1bef176ed6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.636382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf3097-983d-4957-943e-1bef176ed6f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.647894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf3097-983d-4957-943e-1bef176ed6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.649759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bf3097-983d-4957-943e-1bef176ed6f5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-75bf3097-983d-4957-943e-1bef176ed6f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:37.673113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:37.682245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 380/754] 10.222.0.41 () {56 vars in 1117 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f727e-431e-4e7e-b744-decf507d7eab None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.683193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f727e-431e-4e7e-b744-decf507d7eab None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.683887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f727e-431e-4e7e-b744-decf507d7eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.705583 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-782f727e-431e-4e7e-b744-decf507d7eab None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:37.706708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-782f727e-431e-4e7e-b744-decf507d7eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:37.735607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aaea6-b532-46be-a8bc-dfc4daf57e79 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.774122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4f46f-072c-4d18-9f60-de5ac5a7e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.775152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4f46f-072c-4d18-9f60-de5ac5a7e056 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.775680 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4f46f-072c-4d18-9f60-de5ac5a7e056 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.776189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4f46f-072c-4d18-9f60-de5ac5a7e056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.788066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 381/755] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:37.788958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f727e-431e-4e7e-b744-decf507d7eab None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.828841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.850886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.853161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4f46f-072c-4d18-9f60-de5ac5a7e056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.854665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4f46f-072c-4d18-9f60-de5ac5a7e056 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.901344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f727e-431e-4e7e-b744-decf507d7eab None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.942505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf215-ac4a-434b-a70f-ea8baa7cfb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.943820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf215-ac4a-434b-a70f-ea8baa7cfb04 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.944310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf215-ac4a-434b-a70f-ea8baa7cfb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.945063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfaf215-ac4a-434b-a70f-ea8baa7cfb04 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.946606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaf215-ac4a-434b-a70f-ea8baa7cfb04 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.947385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaf215-ac4a-434b-a70f-ea8baa7cfb04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.949924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfaf215-ac4a-434b-a70f-ea8baa7cfb04 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.971194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 375/756] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:24:37.972339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4f46f-072c-4d18-9f60-de5ac5a7e056 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.976653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 382/757] 10.222.0.41 () {56 vars in 1149 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.977603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf215-ac4a-434b-a70f-ea8baa7cfb04 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.063575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.087234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfaf215-ac4a-434b-a70f-ea8baa7cfb04 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.097153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.101284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4f46f-072c-4d18-9f60-de5ac5a7e056 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.128988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1970891-4e7c-4cfe-9a6e-395fd5072de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.130261 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970891-4e7c-4cfe-9a6e-395fd5072de4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.130757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970891-4e7c-4cfe-9a6e-395fd5072de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.131259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1970891-4e7c-4cfe-9a6e-395fd5072de4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.143213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1970891-4e7c-4cfe-9a6e-395fd5072de4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.145128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1970891-4e7c-4cfe-9a6e-395fd5072de4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.145507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c26d8d-d432-4764-9f37-3579f1eeef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.146641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c26d8d-d432-4764-9f37-3579f1eeef25 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.147029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c26d8d-d432-4764-9f37-3579f1eeef25 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.147406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c26d8d-d432-4764-9f37-3579f1eeef25 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.148339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c26d8d-d432-4764-9f37-3579f1eeef25 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.150293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c26d8d-d432-4764-9f37-3579f1eeef25 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-70c26d8d-d432-4764-9f37-3579f1eeef25 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:38.165729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:38.166900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:38.167929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c1970891-4e7c-4cfe-9a6e-395fd5072de4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:38.169535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:38.170573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:38.171725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:38.171725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:38.171725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:38.171725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:38.172016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 376/758] 10.222.0.41 () {56 vars in 1129 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:38.178244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c26d8d-d432-4764-9f37-3579f1eeef25 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.178670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 383/759] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:38.179717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1970891-4e7c-4cfe-9a6e-395fd5072de4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.288483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c26d8d-d432-4764-9f37-3579f1eeef25 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.309983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1970891-4e7c-4cfe-9a6e-395fd5072de4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.346543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d8ff-3198-4aa7-9807-b27db440aebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.347234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d8ff-3198-4aa7-9807-b27db440aebe None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.348155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d8ff-3198-4aa7-9807-b27db440aebe None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.357733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99d8ff-3198-4aa7-9807-b27db440aebe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.361695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.371496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebe41b-4588-4d44-97d8-bee9d190474e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.374071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebe41b-4588-4d44-97d8-bee9d190474e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.374071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebe41b-4588-4d44-97d8-bee9d190474e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.374071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebe41b-4588-4d44-97d8-bee9d190474e None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.377687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebe41b-4588-4d44-97d8-bee9d190474e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:38.377687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebe41b-4588-4d44-97d8-bee9d190474e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.377687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebe41b-4588-4d44-97d8-bee9d190474e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.392010 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.394090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 384/760] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:38.395184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebe41b-4588-4d44-97d8-bee9d190474e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.440530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d8ff-3198-4aa7-9807-b27db440aebe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.443372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99d8ff-3198-4aa7-9807-b27db440aebe None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.533305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebe41b-4588-4d44-97d8-bee9d190474e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.567276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 377/761] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:24:38.568300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d8ff-3198-4aa7-9807-b27db440aebe None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.579618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc522a-ebb1-4e23-a249-53cc619bf999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.580326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc522a-ebb1-4e23-a249-53cc619bf999 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.580989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc522a-ebb1-4e23-a249-53cc619bf999 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.581272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc522a-ebb1-4e23-a249-53cc619bf999 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.582310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc522a-ebb1-4e23-a249-53cc619bf999 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:38.582622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc522a-ebb1-4e23-a249-53cc619bf999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.584718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc522a-ebb1-4e23-a249-53cc619bf999 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.591082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 385/762] 10.222.0.41 () {56 vars in 1124 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:38.591872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc522a-ebb1-4e23-a249-53cc619bf999 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.639095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.664528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.679093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99d8ff-3198-4aa7-9807-b27db440aebe None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.717272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e02014-733a-49be-83cb-a3b67d5ce7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.718744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02014-733a-49be-83cb-a3b67d5ce7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.719029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02014-733a-49be-83cb-a3b67d5ce7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.719317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e02014-733a-49be-83cb-a3b67d5ce7b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.726729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e02014-733a-49be-83cb-a3b67d5ce7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.728007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc522a-ebb1-4e23-a249-53cc619bf999 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.728173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e02014-733a-49be-83cb-a3b67d5ce7b8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e2e02014-733a-49be-83cb-a3b67d5ce7b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:38.742586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:38.743698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:38.744713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:38.744713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:38.744713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:38.744713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:38.744713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:38.744713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:38.744713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:38.744713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:38.744713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 378/763] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:38.744713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e02014-733a-49be-83cb-a3b67d5ce7b8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.770695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b5f11-12e2-4f22-a253-a2883c3a5e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.771819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5f11-12e2-4f22-a253-a2883c3a5e74 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.772291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5f11-12e2-4f22-a253-a2883c3a5e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.772766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b5f11-12e2-4f22-a253-a2883c3a5e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.784070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b5f11-12e2-4f22-a253-a2883c3a5e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.785511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b5f11-12e2-4f22-a253-a2883c3a5e74 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-142b5f11-12e2-4f22-a253-a2883c3a5e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:38.803399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:38.804336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:38.805540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:38.805540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:38.805540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:38.805540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:38.805540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 386/764] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:38.805937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b5f11-12e2-4f22-a253-a2883c3a5e74 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.872915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e02014-733a-49be-83cb-a3b67d5ce7b8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.898575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.910627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181631a-6ac7-4ab5-848e-f3c1692e6ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.911364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181631a-6ac7-4ab5-848e-f3c1692e6ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.911762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181631a-6ac7-4ab5-848e-f3c1692e6ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.912094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181631a-6ac7-4ab5-848e-f3c1692e6ce6 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.912814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181631a-6ac7-4ab5-848e-f3c1692e6ce6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:38.913129 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181631a-6ac7-4ab5-848e-f3c1692e6ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.914639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181631a-6ac7-4ab5-848e-f3c1692e6ce6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.924002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 379/765] 10.222.0.41 () {56 vars in 1124 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:38.924002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181631a-6ac7-4ab5-848e-f3c1692e6ce6 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.924605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b5f11-12e2-4f22-a253-a2883c3a5e74 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.927059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.962071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da445021-e928-44da-afcd-4bab7936a869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.962830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da445021-e928-44da-afcd-4bab7936a869 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.963123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da445021-e928-44da-afcd-4bab7936a869 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.963407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da445021-e928-44da-afcd-4bab7936a869 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.964203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da445021-e928-44da-afcd-4bab7936a869 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:38.964517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da445021-e928-44da-afcd-4bab7936a869 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.966430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da445021-e928-44da-afcd-4bab7936a869 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.984664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 387/766] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:38.984664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da445021-e928-44da-afcd-4bab7936a869 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.036394 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181631a-6ac7-4ab5-848e-f3c1692e6ce6 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.072433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfae8a2-6aae-45e6-b8e8-2f2015f432d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.073490 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfae8a2-6aae-45e6-b8e8-2f2015f432d5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.073973 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfae8a2-6aae-45e6-b8e8-2f2015f432d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.074404 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfae8a2-6aae-45e6-b8e8-2f2015f432d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.075317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfae8a2-6aae-45e6-b8e8-2f2015f432d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.075785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfae8a2-6aae-45e6-b8e8-2f2015f432d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.078074 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfae8a2-6aae-45e6-b8e8-2f2015f432d5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.098009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 380/767] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.099312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfae8a2-6aae-45e6-b8e8-2f2015f432d5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.109756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da445021-e928-44da-afcd-4bab7936a869 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.147960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd0cdf-0d79-4cde-8321-54832b273e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.148685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd0cdf-0d79-4cde-8321-54832b273e35 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.148923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd0cdf-0d79-4cde-8321-54832b273e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.149306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd0cdf-0d79-4cde-8321-54832b273e35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.150179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd0cdf-0d79-4cde-8321-54832b273e35 None admin] RBAC: Adding query filter params (interface=public, service_id=8090bf8315a84117be6cb80402bb87f4, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.150725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd0cdf-0d79-4cde-8321-54832b273e35 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.151953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd0cdf-0d79-4cde-8321-54832b273e35 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.153440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.161383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 388/768] 10.222.0.41 () {56 vars in 1251 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/endpoints?service_id=8090bf8315a84117be6cb80402bb87f4&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.162176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd0cdf-0d79-4cde-8321-54832b273e35 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.192925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.209230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfae8a2-6aae-45e6-b8e8-2f2015f432d5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.245892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb49c3f-e654-4d52-9909-2b0573040719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.246926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb49c3f-e654-4d52-9909-2b0573040719 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.247418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb49c3f-e654-4d52-9909-2b0573040719 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.247896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb49c3f-e654-4d52-9909-2b0573040719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.248973 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb49c3f-e654-4d52-9909-2b0573040719 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=af5ebb39734144418fe35f9f0a679145) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.249548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb49c3f-e654-4d52-9909-2b0573040719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.251243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb49c3f-e654-4d52-9909-2b0573040719 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.261977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 381/769] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/role_assignments?user.id=af5ebb39734144418fe35f9f0a679145&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.263301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb49c3f-e654-4d52-9909-2b0573040719 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.274879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd0cdf-0d79-4cde-8321-54832b273e35 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.316131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f1564-4a21-40da-9dbb-5f8bbf0d40e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.317114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f1564-4a21-40da-9dbb-5f8bbf0d40e4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.317337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f1564-4a21-40da-9dbb-5f8bbf0d40e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.317621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f1564-4a21-40da-9dbb-5f8bbf0d40e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.327798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f1564-4a21-40da-9dbb-5f8bbf0d40e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.329407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f1564-4a21-40da-9dbb-5f8bbf0d40e4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f35f1564-4a21-40da-9dbb-5f8bbf0d40e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:39.346110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:39.347282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:39.348312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:39.348312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:39.348312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:39.348312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:39.348312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:39.348312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:39.348312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:39.348312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:39.348312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 389/770] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:39.349018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86ee3-0697-4663-b248-8b61ba7cee3d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.349317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86ee3-0697-4663-b248-8b61ba7cee3d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.349599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f86ee3-0697-4663-b248-8b61ba7cee3d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.354960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 390/771] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:39.354960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86ee3-0697-4663-b248-8b61ba7cee3d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.394573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb49c3f-e654-4d52-9909-2b0573040719 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.410529 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.434150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab65ca-08e2-4b09-a7f7-5aac7777ce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.435118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab65ca-08e2-4b09-a7f7-5aac7777ce97 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.435557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab65ca-08e2-4b09-a7f7-5aac7777ce97 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.435973 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab65ca-08e2-4b09-a7f7-5aac7777ce97 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.437374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab65ca-08e2-4b09-a7f7-5aac7777ce97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.439098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab65ca-08e2-4b09-a7f7-5aac7777ce97 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.445422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 382/772] 10.222.0.41 () {56 vars in 1087 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.447035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402476ca-d7e1-482c-9970-ab971fa6e598 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.447494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402476ca-d7e1-482c-9970-ab971fa6e598 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.448000 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402476ca-d7e1-482c-9970-ab971fa6e598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.464454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.478991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-402476ca-d7e1-482c-9970-ab971fa6e598 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:39.480590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-402476ca-d7e1-482c-9970-ab971fa6e598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:39.480948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f86ee3-0697-4663-b248-8b61ba7cee3d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.524651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a48dc-44e1-4641-a4cc-b72a655fe846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.524869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a48dc-44e1-4641-a4cc-b72a655fe846 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.525173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a48dc-44e1-4641-a4cc-b72a655fe846 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.525332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a48dc-44e1-4641-a4cc-b72a655fe846 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.526275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a48dc-44e1-4641-a4cc-b72a655fe846 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.526594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a48dc-44e1-4641-a4cc-b72a655fe846 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.528069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0a48dc-44e1-4641-a4cc-b72a655fe846 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.542444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 391/773] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:39.554849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a48dc-44e1-4641-a4cc-b72a655fe846 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.573816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 383/774] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:39.620122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402476ca-d7e1-482c-9970-ab971fa6e598 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.699757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0a48dc-44e1-4641-a4cc-b72a655fe846 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.735864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec1029-30cd-4a27-a79e-46641c60fb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.736531 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec1029-30cd-4a27-a79e-46641c60fb6a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.736894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec1029-30cd-4a27-a79e-46641c60fb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.737096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec1029-30cd-4a27-a79e-46641c60fb6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.738181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec1029-30cd-4a27-a79e-46641c60fb6a None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=2393ed59b5e74a99ae55f15bdc2b5519) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.738320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec1029-30cd-4a27-a79e-46641c60fb6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.739683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec1029-30cd-4a27-a79e-46641c60fb6a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.746874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 392/775] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/role_assignments?user.id=2393ed59b5e74a99ae55f15bdc2b5519&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.748012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402476ca-d7e1-482c-9970-ab971fa6e598 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.756650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.787611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7895e3-7ad2-4bc4-9120-28d99fca5db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.788681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7895e3-7ad2-4bc4-9120-28d99fca5db0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.789106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7895e3-7ad2-4bc4-9120-28d99fca5db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.789525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7895e3-7ad2-4bc4-9120-28d99fca5db0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.790357 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7895e3-7ad2-4bc4-9120-28d99fca5db0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.792227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7895e3-7ad2-4bc4-9120-28d99fca5db0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5c7895e3-7ad2-4bc4-9120-28d99fca5db0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:39.805856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:39.807068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:39.808062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:39.811352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 384/776] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:39.817002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec1029-30cd-4a27-a79e-46641c60fb6a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.835951 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.963216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec1029-30cd-4a27-a79e-46641c60fb6a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.012929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983037-a8a8-430f-949a-8fa103edcfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.013609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983037-a8a8-430f-949a-8fa103edcfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.013931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983037-a8a8-430f-949a-8fa103edcfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.014215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983037-a8a8-430f-949a-8fa103edcfc3 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.015456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983037-a8a8-430f-949a-8fa103edcfc3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:40.015770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983037-a8a8-430f-949a-8fa103edcfc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.017133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983037-a8a8-430f-949a-8fa103edcfc3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.022353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 393/777] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:40.027579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7895e3-7ad2-4bc4-9120-28d99fca5db0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.152886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee988b0-1482-407a-a284-156ca3a013e5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.153472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee988b0-1482-407a-a284-156ca3a013e5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.154026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee988b0-1482-407a-a284-156ca3a013e5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.156402 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 394/778] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:40.161479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b254ad5-a225-455f-8b0d-f78a7c28f3cd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.162086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b254ad5-a225-455f-8b0d-f78a7c28f3cd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.162508 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b254ad5-a225-455f-8b0d-f78a7c28f3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.183413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7895e3-7ad2-4bc4-9120-28d99fca5db0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.194739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9b254ad5-a225-455f-8b0d-f78a7c28f3cd None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:40.196179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9b254ad5-a225-455f-8b0d-f78a7c28f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:40.246490 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bff641-82b0-4ccc-a1b3-414abdfff436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.247417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bff641-82b0-4ccc-a1b3-414abdfff436 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.247867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bff641-82b0-4ccc-a1b3-414abdfff436 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.248304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bff641-82b0-4ccc-a1b3-414abdfff436 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.251105 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bff641-82b0-4ccc-a1b3-414abdfff436 None admin] RBAC: Adding query filter params (type=network) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:40.251602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bff641-82b0-4ccc-a1b3-414abdfff436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.253136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bff641-82b0-4ccc-a1b3-414abdfff436 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.262513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 385/779] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:40.268326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bff641-82b0-4ccc-a1b3-414abdfff436 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.317754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 395/780] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:24:40.337064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.361812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b254ad5-a225-455f-8b0d-f78a7c28f3cd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.374505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.469367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bff641-82b0-4ccc-a1b3-414abdfff436 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.528228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174e288-3455-4f7c-bf80-9bee1e2638a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.528817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174e288-3455-4f7c-bf80-9bee1e2638a7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.529103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174e288-3455-4f7c-bf80-9bee1e2638a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.529382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174e288-3455-4f7c-bf80-9bee1e2638a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.530253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174e288-3455-4f7c-bf80-9bee1e2638a7 None admin] RBAC: Adding query filter params (interface=public, service_id=4ce9febf7e5144ebb01b430f334011af, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:40.530902 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174e288-3455-4f7c-bf80-9bee1e2638a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.532286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3174e288-3455-4f7c-bf80-9bee1e2638a7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.541072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 386/781] 10.222.0.41 () {56 vars in 1251 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/endpoints?service_id=4ce9febf7e5144ebb01b430f334011af&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:40.547313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174e288-3455-4f7c-bf80-9bee1e2638a7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.553160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b254ad5-a225-455f-8b0d-f78a7c28f3cd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.628637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1b1d-ec8c-41da-baaa-1c71707d2a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.629440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1b1d-ec8c-41da-baaa-1c71707d2a25 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.629746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1b1d-ec8c-41da-baaa-1c71707d2a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.630025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea1b1d-ec8c-41da-baaa-1c71707d2a25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.654694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea1b1d-ec8c-41da-baaa-1c71707d2a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d2ea1b1d-ec8c-41da-baaa-1c71707d2a25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:40.672984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:40.674042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:40.674877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:40.679173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 396/782] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:40.680421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1b1d-ec8c-41da-baaa-1c71707d2a25 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.753858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.759301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174e288-3455-4f7c-bf80-9bee1e2638a7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.802203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:40.839161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea1b1d-ec8c-41da-baaa-1c71707d2a25 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:40.876799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b691a-473a-4639-a665-d544ba7276f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.877467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b691a-473a-4639-a665-d544ba7276f3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.877793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b691a-473a-4639-a665-d544ba7276f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.878221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b691a-473a-4639-a665-d544ba7276f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.879405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b691a-473a-4639-a665-d544ba7276f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:40.879717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b691a-473a-4639-a665-d544ba7276f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.881073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b691a-473a-4639-a665-d544ba7276f3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.890118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 397/783] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:40.897442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b691a-473a-4639-a665-d544ba7276f3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:40.898405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5b04a-6650-412c-9443-c4ea130ce569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.899089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b04a-6650-412c-9443-c4ea130ce569 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.899376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b04a-6650-412c-9443-c4ea130ce569 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.899656 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b04a-6650-412c-9443-c4ea130ce569 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.900345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5b04a-6650-412c-9443-c4ea130ce569 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.901755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5b04a-6650-412c-9443-c4ea130ce569 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.916223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 387/784] 10.222.0.41 () {56 vars in 1087 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/services => generated 772 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:41.067563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b691a-473a-4639-a665-d544ba7276f3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.114567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.133265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673f1d2-045a-402f-8117-3a520eaadb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.134199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673f1d2-045a-402f-8117-3a520eaadb54 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.134488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673f1d2-045a-402f-8117-3a520eaadb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.134766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673f1d2-045a-402f-8117-3a520eaadb54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.149509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673f1d2-045a-402f-8117-3a520eaadb54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.154080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673f1d2-045a-402f-8117-3a520eaadb54 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2673f1d2-045a-402f-8117-3a520eaadb54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:41.173407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:41.174378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:41.175239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:41.175239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:41.175239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:41.175239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:41.175239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 398/785] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:41.180241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5b04a-6650-412c-9443-c4ea130ce569 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.292534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5b04a-6650-412c-9443-c4ea130ce569 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.332310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bd86c-7bd9-4a40-99cf-48d43a847217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.332920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bd86c-7bd9-4a40-99cf-48d43a847217 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.333208 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bd86c-7bd9-4a40-99cf-48d43a847217 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.333489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61bd86c-7bd9-4a40-99cf-48d43a847217 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.334257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bd86c-7bd9-4a40-99cf-48d43a847217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:41.334568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bd86c-7bd9-4a40-99cf-48d43a847217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.335958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61bd86c-7bd9-4a40-99cf-48d43a847217 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.348902 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 388/786] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:41.359293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673f1d2-045a-402f-8117-3a520eaadb54 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.478054 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673f1d2-045a-402f-8117-3a520eaadb54 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.528930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7a06c-8547-4dc8-a225-705a6e8fa2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.529747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7a06c-8547-4dc8-a225-705a6e8fa2ff None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.530034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7a06c-8547-4dc8-a225-705a6e8fa2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.530370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7a06c-8547-4dc8-a225-705a6e8fa2ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.541096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7a06c-8547-4dc8-a225-705a6e8fa2ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.542555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7a06c-8547-4dc8-a225-705a6e8fa2ff None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-44c7a06c-8547-4dc8-a225-705a6e8fa2ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:41.559972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:41.562630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:41.564867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 399/787] 10.222.0.41 () {56 vars in 1093 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:41.569695 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bd86c-7bd9-4a40-99cf-48d43a847217 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.617689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.709001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61bd86c-7bd9-4a40-99cf-48d43a847217 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.746613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568057f-8dd5-4211-a74b-7f2203cca9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.747600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568057f-8dd5-4211-a74b-7f2203cca9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.748063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568057f-8dd5-4211-a74b-7f2203cca9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.748521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568057f-8dd5-4211-a74b-7f2203cca9b7 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.749695 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568057f-8dd5-4211-a74b-7f2203cca9b7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:41.750191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568057f-8dd5-4211-a74b-7f2203cca9b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.751813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568057f-8dd5-4211-a74b-7f2203cca9b7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.770232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 389/788] 10.222.0.41 () {56 vars in 1133 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:41.779080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7a06c-8547-4dc8-a225-705a6e8fa2ff None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.847023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.892689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a207d-cc97-4ff8-970e-433b7dbe84c7 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.893296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a207d-cc97-4ff8-970e-433b7dbe84c7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.893843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a207d-cc97-4ff8-970e-433b7dbe84c7 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.895672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 390/789] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:41.901563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b767182-886e-4b5e-8c56-a49f0879e0bb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.901891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b767182-886e-4b5e-8c56-a49f0879e0bb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.902104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b767182-886e-4b5e-8c56-a49f0879e0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.928275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2b767182-886e-4b5e-8c56-a49f0879e0bb None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:41.929869 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2b767182-886e-4b5e-8c56-a49f0879e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:41.940585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7a06c-8547-4dc8-a225-705a6e8fa2ff None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.003367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 391/790] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:42.016213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178a94b-46b3-4a45-b1db-95cef4ae3295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.017136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178a94b-46b3-4a45-b1db-95cef4ae3295 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.017631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178a94b-46b3-4a45-b1db-95cef4ae3295 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.018139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178a94b-46b3-4a45-b1db-95cef4ae3295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.039075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b767182-886e-4b5e-8c56-a49f0879e0bb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.078057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.126028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178a94b-46b3-4a45-b1db-95cef4ae3295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.127493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178a94b-46b3-4a45-b1db-95cef4ae3295 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.153574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b767182-886e-4b5e-8c56-a49f0879e0bb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.169244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.192414 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ad975-dbd4-4de8-8f16-0623ed25b741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.193454 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ad975-dbd4-4de8-8f16-0623ed25b741 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.193928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ad975-dbd4-4de8-8f16-0623ed25b741 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.194425 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ad975-dbd4-4de8-8f16-0623ed25b741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.206594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ad975-dbd4-4de8-8f16-0623ed25b741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-802ad975-dbd4-4de8-8f16-0623ed25b741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:42.215232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.216319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:42.217268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:42.224223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 392/791] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:42.225862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b862a4-463c-4529-bd80-d07f8b956aa4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.226372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b862a4-463c-4529-bd80-d07f8b956aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.226895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b862a4-463c-4529-bd80-d07f8b956aa4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.228660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 393/792] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:42.229557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b862a4-463c-4529-bd80-d07f8b956aa4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.231608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 400/793] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:24:42.238074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146ad9c-e011-46f7-a877-c6c8d6ed0fcd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.238370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146ad9c-e011-46f7-a877-c6c8d6ed0fcd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.238654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4146ad9c-e011-46f7-a877-c6c8d6ed0fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.257649 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4146ad9c-e011-46f7-a877-c6c8d6ed0fcd None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:42.258852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4146ad9c-e011-46f7-a877-c6c8d6ed0fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:42.315359 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.334284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 401/794] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:42.335144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146ad9c-e011-46f7-a877-c6c8d6ed0fcd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.350378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b862a4-463c-4529-bd80-d07f8b956aa4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.388571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e206a7-339b-4cab-ad61-484727b556b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.389644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e206a7-339b-4cab-ad61-484727b556b3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.390229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e206a7-339b-4cab-ad61-484727b556b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.390763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e206a7-339b-4cab-ad61-484727b556b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.391871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e206a7-339b-4cab-ad61-484727b556b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.392378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e206a7-339b-4cab-ad61-484727b556b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.394131 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e206a7-339b-4cab-ad61-484727b556b3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.403790 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 394/795] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:42.409966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.411333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e206a7-339b-4cab-ad61-484727b556b3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.440678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4146ad9c-e011-46f7-a877-c6c8d6ed0fcd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.478981 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384a879-0b8f-4311-a544-f724f142bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.480351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384a879-0b8f-4311-a544-f724f142bda1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.480648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384a879-0b8f-4311-a544-f724f142bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.480932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384a879-0b8f-4311-a544-f724f142bda1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.493860 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384a879-0b8f-4311-a544-f724f142bda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.495683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384a879-0b8f-4311-a544-f724f142bda1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4384a879-0b8f-4311-a544-f724f142bda1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:42.515746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.516682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.517546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:42.517546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:42.517546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:42.517546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:42.517546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 402/796] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:42.517850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384a879-0b8f-4311-a544-f724f142bda1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.529702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e206a7-339b-4cab-ad61-484727b556b3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.565025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.570454 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602ba90-5a2d-4fd3-8fba-27e2471fcb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.571203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ba90-5a2d-4fd3-8fba-27e2471fcb03 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.571497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ba90-5a2d-4fd3-8fba-27e2471fcb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.571773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602ba90-5a2d-4fd3-8fba-27e2471fcb03 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.584711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ba90-5a2d-4fd3-8fba-27e2471fcb03 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.584711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602ba90-5a2d-4fd3-8fba-27e2471fcb03 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-f602ba90-5a2d-4fd3-8fba-27e2471fcb03 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.586142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.587014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:42.587819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 395/797] 10.222.0.41 () {56 vars in 1129 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:42.588630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95733736-ff7b-478a-a824-c0e1977cbb93 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.589280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95733736-ff7b-478a-a824-c0e1977cbb93 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.589280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95733736-ff7b-478a-a824-c0e1977cbb93 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.595054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 396/798] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:42.595054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95733736-ff7b-478a-a824-c0e1977cbb93 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.634237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384a879-0b8f-4311-a544-f724f142bda1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.658396 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.669820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2378e6-9e7c-4070-821b-35eda67e3f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.670872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2378e6-9e7c-4070-821b-35eda67e3f23 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.671162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2378e6-9e7c-4070-821b-35eda67e3f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.671442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2378e6-9e7c-4070-821b-35eda67e3f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.681512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2378e6-9e7c-4070-821b-35eda67e3f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.683016 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2378e6-9e7c-4070-821b-35eda67e3f23 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ae2378e6-9e7c-4070-821b-35eda67e3f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:42.700927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.701857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.702829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:42.702829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:42.702829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:42.702829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:42.702829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 403/799] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:42.703724 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2378e6-9e7c-4070-821b-35eda67e3f23 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.713282 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95733736-ff7b-478a-a824-c0e1977cbb93 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.748115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78084b1-6837-4729-941c-fb38946b363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.748816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78084b1-6837-4729-941c-fb38946b363a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.749141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78084b1-6837-4729-941c-fb38946b363a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.749418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78084b1-6837-4729-941c-fb38946b363a None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.750167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78084b1-6837-4729-941c-fb38946b363a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.750477 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78084b1-6837-4729-941c-fb38946b363a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.751854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78084b1-6837-4729-941c-fb38946b363a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.763838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 397/800] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:42.765548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceb809-ab65-47c5-9d63-2fbad1012a44 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.765859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceb809-ab65-47c5-9d63-2fbad1012a44 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.766138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceb809-ab65-47c5-9d63-2fbad1012a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.782206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e2ceb809-ab65-47c5-9d63-2fbad1012a44 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:42.783372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e2ceb809-ab65-47c5-9d63-2fbad1012a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:42.813224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2378e6-9e7c-4070-821b-35eda67e3f23 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.836519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.850773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0670c-0d63-474a-beef-f8791d2c609e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.851843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0670c-0d63-474a-beef-f8791d2c609e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.852306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0670c-0d63-474a-beef-f8791d2c609e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.852753 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0670c-0d63-474a-beef-f8791d2c609e None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.853453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 398/801] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:42.853965 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0670c-0d63-474a-beef-f8791d2c609e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.854362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ceb809-ab65-47c5-9d63-2fbad1012a44 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.854611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0670c-0d63-474a-beef-f8791d2c609e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.856213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e0670c-0d63-474a-beef-f8791d2c609e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.869102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 404/802] 10.222.0.41 () {56 vars in 1124 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:42.870669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0670c-0d63-474a-beef-f8791d2c609e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.929453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.982181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ceb809-ab65-47c5-9d63-2fbad1012a44 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.992313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e0670c-0d63-474a-beef-f8791d2c609e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.020083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12263c6b-7aad-46f4-aa71-163ad6481849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.021073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12263c6b-7aad-46f4-aa71-163ad6481849 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.021536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12263c6b-7aad-46f4-aa71-163ad6481849 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.022289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12263c6b-7aad-46f4-aa71-163ad6481849 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.023772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12263c6b-7aad-46f4-aa71-163ad6481849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.024560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12263c6b-7aad-46f4-aa71-163ad6481849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.027411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12263c6b-7aad-46f4-aa71-163ad6481849 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.028191 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f5bd-7678-48c4-928d-b86adeff6511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.028977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f5bd-7678-48c4-928d-b86adeff6511 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.029260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f5bd-7678-48c4-928d-b86adeff6511 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.029541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788f5bd-7678-48c4-928d-b86adeff6511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.037657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788f5bd-7678-48c4-928d-b86adeff6511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.039119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788f5bd-7678-48c4-928d-b86adeff6511 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.046456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 399/803] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.047295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12263c6b-7aad-46f4-aa71-163ad6481849 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6788f5bd-7678-48c4-928d-b86adeff6511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:43.058796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:43.059676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:43.060560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:43.060560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:43.060560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:43.060560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:43.060560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:43.060560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:43.060560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:43.060560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:43.062398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 405/804] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:43.063314 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f5bd-7678-48c4-928d-b86adeff6511 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.115123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.170096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12263c6b-7aad-46f4-aa71-163ad6481849 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.172950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.177793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788f5bd-7678-48c4-928d-b86adeff6511 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.208654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e630-2ddc-4141-983e-3c88eace5f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.209243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e630-2ddc-4141-983e-3c88eace5f7e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.209526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e630-2ddc-4141-983e-3c88eace5f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.209844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64e630-2ddc-4141-983e-3c88eace5f7e None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.210546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e630-2ddc-4141-983e-3c88eace5f7e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.210852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e630-2ddc-4141-983e-3c88eace5f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.212250 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64e630-2ddc-4141-983e-3c88eace5f7e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.217256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 400/805] 10.222.0.41 () {56 vars in 1124 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.218793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e630-2ddc-4141-983e-3c88eace5f7e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.223929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d857f3f-b7ec-41cc-81fa-ea3bc751c7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.224733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d857f3f-b7ec-41cc-81fa-ea3bc751c7ba None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.225015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d857f3f-b7ec-41cc-81fa-ea3bc751c7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.225289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d857f3f-b7ec-41cc-81fa-ea3bc751c7ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.237291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d857f3f-b7ec-41cc-81fa-ea3bc751c7ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8d857f3f-b7ec-41cc-81fa-ea3bc751c7ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:43.247365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:43.248269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:43.249124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:43.249784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 406/806] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:43.250349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d857f3f-b7ec-41cc-81fa-ea3bc751c7ba None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.329534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64e630-2ddc-4141-983e-3c88eace5f7e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.339900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.363337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d857f3f-b7ec-41cc-81fa-ea3bc751c7ba None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.364761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3cadf-968a-4d01-a5c9-713f246e52fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.365555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3cadf-968a-4d01-a5c9-713f246e52fe None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.365872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3cadf-968a-4d01-a5c9-713f246e52fe None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.366145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3cadf-968a-4d01-a5c9-713f246e52fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.374648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3cadf-968a-4d01-a5c9-713f246e52fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.377345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a3cadf-968a-4d01-a5c9-713f246e52fe None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e6a3cadf-968a-4d01-a5c9-713f246e52fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:43.391803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:43.392720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:43.393633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 401/807] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:43.394771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3cadf-968a-4d01-a5c9-713f246e52fe None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.406352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d622-273c-410c-a7ae-915ea07b1842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.407076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d622-273c-410c-a7ae-915ea07b1842 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.407633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d622-273c-410c-a7ae-915ea07b1842 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.407633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6d622-273c-410c-a7ae-915ea07b1842 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.408421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6d622-273c-410c-a7ae-915ea07b1842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.408733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6d622-273c-410c-a7ae-915ea07b1842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.410297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6d622-273c-410c-a7ae-915ea07b1842 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.423854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 407/808] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.424715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d622-273c-410c-a7ae-915ea07b1842 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.446245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.509150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3cadf-968a-4d01-a5c9-713f246e52fe None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.531836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6d622-273c-410c-a7ae-915ea07b1842 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.542513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cc8ff-c014-48ee-aabb-f6018a31ec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.543849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cc8ff-c014-48ee-aabb-f6018a31ec71 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.544592 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cc8ff-c014-48ee-aabb-f6018a31ec71 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.545070 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cc8ff-c014-48ee-aabb-f6018a31ec71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.547030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cc8ff-c014-48ee-aabb-f6018a31ec71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.549033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cc8ff-c014-48ee-aabb-f6018a31ec71 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.569348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329123cc-b7d8-46b7-b175-a6ae1ceaec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.570040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329123cc-b7d8-46b7-b175-a6ae1ceaec04 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.573505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329123cc-b7d8-46b7-b175-a6ae1ceaec04 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.573505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329123cc-b7d8-46b7-b175-a6ae1ceaec04 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.573505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329123cc-b7d8-46b7-b175-a6ae1ceaec04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.573505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329123cc-b7d8-46b7-b175-a6ae1ceaec04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.573505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329123cc-b7d8-46b7-b175-a6ae1ceaec04 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.581934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 408/809] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.582812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329123cc-b7d8-46b7-b175-a6ae1ceaec04 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.661227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.666869 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 402/810] 10.222.0.41 () {60 vars in 1144 bytes} [Thu May 26 12:24:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:43.667922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cc8ff-c014-48ee-aabb-f6018a31ec71 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.680945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329123cc-b7d8-46b7-b175-a6ae1ceaec04 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.699614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.725060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfae384-1331-43f2-ada1-561e8c5eca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.725952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae384-1331-43f2-ada1-561e8c5eca0e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.726237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae384-1331-43f2-ada1-561e8c5eca0e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.726542 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae384-1331-43f2-ada1-561e8c5eca0e None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.727398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfae384-1331-43f2-ada1-561e8c5eca0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.727749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfae384-1331-43f2-ada1-561e8c5eca0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.729191 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfae384-1331-43f2-ada1-561e8c5eca0e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.748374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 409/811] 10.222.0.41 () {56 vars in 1135 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.749326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfae384-1331-43f2-ada1-561e8c5eca0e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.782906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cc8ff-c014-48ee-aabb-f6018a31ec71 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.822057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06d0c6-fbc4-40db-9bcb-2b2b463c35bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.822650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d0c6-fbc4-40db-9bcb-2b2b463c35bb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.823026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d0c6-fbc4-40db-9bcb-2b2b463c35bb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.823202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d0c6-fbc4-40db-9bcb-2b2b463c35bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.824043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d0c6-fbc4-40db-9bcb-2b2b463c35bb None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=a1e4a66515654e1f9f7452740ff4ce58) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.824355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d0c6-fbc4-40db-9bcb-2b2b463c35bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.825859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d0c6-fbc4-40db-9bcb-2b2b463c35bb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.837703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 403/812] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/role_assignments?user.id=a1e4a66515654e1f9f7452740ff4ce58&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.837703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04c7ef-3a6e-45e1-915f-e6d63291e523 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.837703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04c7ef-3a6e-45e1-915f-e6d63291e523 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.837703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04c7ef-3a6e-45e1-915f-e6d63291e523 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.837703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 404/813] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:43.837703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04c7ef-3a6e-45e1-915f-e6d63291e523 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.874609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfae384-1331-43f2-ada1-561e8c5eca0e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.920235 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6fd85-58d4-4350-b2ca-7eb81989cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.921117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6fd85-58d4-4350-b2ca-7eb81989cffa None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.922100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6fd85-58d4-4350-b2ca-7eb81989cffa None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.922386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6fd85-58d4-4350-b2ca-7eb81989cffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.924833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.939018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6fd85-58d4-4350-b2ca-7eb81989cffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.941202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6fd85-58d4-4350-b2ca-7eb81989cffa None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.956564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.966432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04c7ef-3a6e-45e1-915f-e6d63291e523 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-19d6fd85-58d4-4350-b2ca-7eb81989cffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:43.972274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:43.973410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:43.974570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:43.974570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:43.974570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:43.974570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:43.977085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 410/814] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:43.979178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e86b-6c8a-4d48-8f44-f295cdedc300 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.980060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e86b-6c8a-4d48-8f44-f295cdedc300 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.980834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9673e86b-6c8a-4d48-8f44-f295cdedc300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.004733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9673e86b-6c8a-4d48-8f44-f295cdedc300 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:44.007047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9673e86b-6c8a-4d48-8f44-f295cdedc300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:44.010322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f695456-9a0b-4d36-8c97-7ac2e3c2631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.012161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f695456-9a0b-4d36-8c97-7ac2e3c2631b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.012450 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f695456-9a0b-4d36-8c97-7ac2e3c2631b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.012727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f695456-9a0b-4d36-8c97-7ac2e3c2631b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.026667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f695456-9a0b-4d36-8c97-7ac2e3c2631b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.028527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f695456-9a0b-4d36-8c97-7ac2e3c2631b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9f695456-9a0b-4d36-8c97-7ac2e3c2631b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:44.050465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:44.051376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:44.052216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:44.052216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:44.052216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:44.052216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:44.056315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 405/815] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:44.057190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f695456-9a0b-4d36-8c97-7ac2e3c2631b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.109209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 411/816] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:44.110155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673e86b-6c8a-4d48-8f44-f295cdedc300 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.189041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f695456-9a0b-4d36-8c97-7ac2e3c2631b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.220515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9673e86b-6c8a-4d48-8f44-f295cdedc300 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.234970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3be075-bd69-4e8a-b2e1-882548da3375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.236574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3be075-bd69-4e8a-b2e1-882548da3375 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.237192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3be075-bd69-4e8a-b2e1-882548da3375 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.237693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3be075-bd69-4e8a-b2e1-882548da3375 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.238337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.239887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3be075-bd69-4e8a-b2e1-882548da3375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.240404 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3be075-bd69-4e8a-b2e1-882548da3375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.242033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3be075-bd69-4e8a-b2e1-882548da3375 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.257901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4a171-bb55-4426-9fd0-ad5e52ecb446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.258276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 406/817] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:44.258537 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4a171-bb55-4426-9fd0-ad5e52ecb446 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.258821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4a171-bb55-4426-9fd0-ad5e52ecb446 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.259097 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4a171-bb55-4426-9fd0-ad5e52ecb446 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.259825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4a171-bb55-4426-9fd0-ad5e52ecb446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.260130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4a171-bb55-4426-9fd0-ad5e52ecb446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.260393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3be075-bd69-4e8a-b2e1-882548da3375 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.261503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4a171-bb55-4426-9fd0-ad5e52ecb446 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.263767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.275696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 412/818] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:44.276717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4a171-bb55-4426-9fd0-ad5e52ecb446 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.387092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4a171-bb55-4426-9fd0-ad5e52ecb446 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.388331 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3be075-bd69-4e8a-b2e1-882548da3375 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.424711 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6325a47-69c8-45d8-b30e-38c829213f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.425964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325a47-69c8-45d8-b30e-38c829213f2a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.426393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325a47-69c8-45d8-b30e-38c829213f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.426808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6325a47-69c8-45d8-b30e-38c829213f2a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.431502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcddde2-69e1-4e19-8059-c3e67e20c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.432431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcddde2-69e1-4e19-8059-c3e67e20c8fa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.433073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcddde2-69e1-4e19-8059-c3e67e20c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.433187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcddde2-69e1-4e19-8059-c3e67e20c8fa None admin] PATH_INFO: `/v3/services/network` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.433959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcddde2-69e1-4e19-8059-c3e67e20c8fa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.435659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6325a47-69c8-45d8-b30e-38c829213f2a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.435780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcddde2-69e1-4e19-8059-c3e67e20c8fa None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.437483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6325a47-69c8-45d8-b30e-38c829213f2a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-cdcddde2-69e1-4e19-8059-c3e67e20c8fa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:44.449493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:44.450558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:44.451354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 407/819] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:44.452654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcddde2-69e1-4e19-8059-c3e67e20c8fa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e6325a47-69c8-45d8-b30e-38c829213f2a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:44.457643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:44.458642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:44.459533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:44.459533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:44.459533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:44.459533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:44.459533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:44.459533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:44.459533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:44.459533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:44.459533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:24:44.459533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:44.462243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 413/820] 10.222.0.41 () {56 vars in 1117 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:44.463352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6325a47-69c8-45d8-b30e-38c829213f2a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.503793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.542466 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.579422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcddde2-69e1-4e19-8059-c3e67e20c8fa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.584149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6325a47-69c8-45d8-b30e-38c829213f2a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.618380 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea886ff1-6878-4833-84de-4dddf64b445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.619540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886ff1-6878-4833-84de-4dddf64b445e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.620271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886ff1-6878-4833-84de-4dddf64b445e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.620758 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea886ff1-6878-4833-84de-4dddf64b445e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.628614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea886ff1-6878-4833-84de-4dddf64b445e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.632619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c27136-ed8c-43a2-bf95-97d5e9d756e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.632619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c27136-ed8c-43a2-bf95-97d5e9d756e9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.632619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c27136-ed8c-43a2-bf95-97d5e9d756e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.632905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea886ff1-6878-4833-84de-4dddf64b445e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.632991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c27136-ed8c-43a2-bf95-97d5e9d756e9 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.632991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c27136-ed8c-43a2-bf95-97d5e9d756e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.632991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c27136-ed8c-43a2-bf95-97d5e9d756e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.633211 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c27136-ed8c-43a2-bf95-97d5e9d756e9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.639118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 414/821] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:44.639919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c27136-ed8c-43a2-bf95-97d5e9d756e9 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ea886ff1-6878-4833-84de-4dddf64b445e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:44.645896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:44.646734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:44.647593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:44.647593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:44.647593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:44.647593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:44.647593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:44.647593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:44.647593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:44.647593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:44.647593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 408/822] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:44.648409 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea886ff1-6878-4833-84de-4dddf64b445e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.756528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.760788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c27136-ed8c-43a2-bf95-97d5e9d756e9 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.770066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea886ff1-6878-4833-84de-4dddf64b445e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.798369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.807964 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757227c-35a0-4ba0-8f7c-9ffcddf6ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.808623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757227c-35a0-4ba0-8f7c-9ffcddf6ee49 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.808906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757227c-35a0-4ba0-8f7c-9ffcddf6ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.809185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757227c-35a0-4ba0-8f7c-9ffcddf6ee49 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.809905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757227c-35a0-4ba0-8f7c-9ffcddf6ee49 None admin] RBAC: Adding query filter params (type=network) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.811827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757227c-35a0-4ba0-8f7c-9ffcddf6ee49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.812027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6a683-dcf1-402c-a0d9-168a991735a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.812027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a683-dcf1-402c-a0d9-168a991735a7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.812207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757227c-35a0-4ba0-8f7c-9ffcddf6ee49 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.812288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a683-dcf1-402c-a0d9-168a991735a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.812648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a683-dcf1-402c-a0d9-168a991735a7 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.814245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6a683-dcf1-402c-a0d9-168a991735a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.814666 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6a683-dcf1-402c-a0d9-168a991735a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.816464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6a683-dcf1-402c-a0d9-168a991735a7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.817316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 409/823] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:44.818288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757227c-35a0-4ba0-8f7c-9ffcddf6ee49 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.841383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 415/824] 10.222.0.41 () {56 vars in 1149 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:44.843184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6a683-dcf1-402c-a0d9-168a991735a7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.928413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757227c-35a0-4ba0-8f7c-9ffcddf6ee49 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.968597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6a683-dcf1-402c-a0d9-168a991735a7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.973217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e91605-fd2b-4474-9bd0-9c9bc58a8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.974036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91605-fd2b-4474-9bd0-9c9bc58a8be0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.974423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91605-fd2b-4474-9bd0-9c9bc58a8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.974802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91605-fd2b-4474-9bd0-9c9bc58a8be0 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.975701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e91605-fd2b-4474-9bd0-9c9bc58a8be0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.976114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e91605-fd2b-4474-9bd0-9c9bc58a8be0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.978106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e91605-fd2b-4474-9bd0-9c9bc58a8be0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.994408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 410/825] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:44.995649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e91605-fd2b-4474-9bd0-9c9bc58a8be0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.010687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020122d-0051-458b-8a3c-677842b2d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.011356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020122d-0051-458b-8a3c-677842b2d1c3 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.011642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020122d-0051-458b-8a3c-677842b2d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.011922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020122d-0051-458b-8a3c-677842b2d1c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.012729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020122d-0051-458b-8a3c-677842b2d1c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.014262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020122d-0051-458b-8a3c-677842b2d1c3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.052658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:45.089757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 416/826] 10.222.0.41 () {60 vars in 1144 bytes} [Thu May 26 12:24:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:45.091020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020122d-0051-458b-8a3c-677842b2d1c3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.126094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:45.147017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e91605-fd2b-4474-9bd0-9c9bc58a8be0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.235546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16688cbd-2d3f-4316-a596-36d9f071ad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.236696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688cbd-2d3f-4316-a596-36d9f071ad05 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.237201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688cbd-2d3f-4316-a596-36d9f071ad05 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.237845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16688cbd-2d3f-4316-a596-36d9f071ad05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.262540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16688cbd-2d3f-4316-a596-36d9f071ad05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.266419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16688cbd-2d3f-4316-a596-36d9f071ad05 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-16688cbd-2d3f-4316-a596-36d9f071ad05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:45.299455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:45.300413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:45.301321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:45.301321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:45.301321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:45.301321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:45.306388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 411/827] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:45.311570 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16688cbd-2d3f-4316-a596-36d9f071ad05 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.315571 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020122d-0051-458b-8a3c-677842b2d1c3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.363889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69633b-5f52-49de-bc51-164ee2e5927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.365451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69633b-5f52-49de-bc51-164ee2e5927f None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.365987 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69633b-5f52-49de-bc51-164ee2e5927f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.366650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69633b-5f52-49de-bc51-164ee2e5927f None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/af5ebb39734144418fe35f9f0a679145/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.368961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69633b-5f52-49de-bc51-164ee2e5927f None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=af5ebb39734144418fe35f9f0a679145, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.371899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69633b-5f52-49de-bc51-164ee2e5927f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.440111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 417/828] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:24:45 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/af5ebb39734144418fe35f9f0a679145/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:45.453582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:45.458614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16688cbd-2d3f-4316-a596-36d9f071ad05 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.503041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9292f8-0afc-407d-878e-cc45a06d0a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.503652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9292f8-0afc-407d-878e-cc45a06d0a20 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.503941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9292f8-0afc-407d-878e-cc45a06d0a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.504228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9292f8-0afc-407d-878e-cc45a06d0a20 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.504975 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9292f8-0afc-407d-878e-cc45a06d0a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:45.505288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9292f8-0afc-407d-878e-cc45a06d0a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.507052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9292f8-0afc-407d-878e-cc45a06d0a20 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.521994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 412/829] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:45.527337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69633b-5f52-49de-bc51-164ee2e5927f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.613352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:45.641919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69633b-5f52-49de-bc51-164ee2e5927f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.678520 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b5e9-2f7e-4864-be06-efba33ff7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.679893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b5e9-2f7e-4864-be06-efba33ff7890 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.680382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b5e9-2f7e-4864-be06-efba33ff7890 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.680879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b5e9-2f7e-4864-be06-efba33ff7890 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.688824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7b5e9-2f7e-4864-be06-efba33ff7890 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.690545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7b5e9-2f7e-4864-be06-efba33ff7890 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-dbf7b5e9-2f7e-4864-be06-efba33ff7890 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:45.705709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:45.706705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:45.707564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:45.707564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:45.707564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:45.707564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:45.707564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:45.707564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:45.707564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:45.707564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:45.710148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 418/830] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:45.717736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9292f8-0afc-407d-878e-cc45a06d0a20 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.823854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9292f8-0afc-407d-878e-cc45a06d0a20 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:45.862868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6a271-c593-4fc5-b215-b6db1860ff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:45.863542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a271-c593-4fc5-b215-b6db1860ff1b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.863827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a271-c593-4fc5-b215-b6db1860ff1b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.864105 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6a271-c593-4fc5-b215-b6db1860ff1b None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.864902 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6a271-c593-4fc5-b215-b6db1860ff1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:45.865218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6a271-c593-4fc5-b215-b6db1860ff1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:45.866696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6a271-c593-4fc5-b215-b6db1860ff1b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:45.880081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 413/831] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:45.885742 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b5e9-2f7e-4864-be06-efba33ff7890 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:45.995799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b5e9-2f7e-4864-be06-efba33ff7890 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.011438 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e18ca9-8620-439b-87a6-a7816aa828d8 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.011742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e18ca9-8620-439b-87a6-a7816aa828d8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.012016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e18ca9-8620-439b-87a6-a7816aa828d8 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.013500 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 414/832] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:46.019272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3833a-f3c3-4a9f-a125-87d8b3efae51 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.019554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3833a-f3c3-4a9f-a125-87d8b3efae51 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.019834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3833a-f3c3-4a9f-a125-87d8b3efae51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.034703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce0a76-c971-4e6d-b071-a9b9d75fa431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.035610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce0a76-c971-4e6d-b071-a9b9d75fa431 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.035897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce0a76-c971-4e6d-b071-a9b9d75fa431 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.036175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce0a76-c971-4e6d-b071-a9b9d75fa431 None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/2393ed59b5e74a99ae55f15bdc2b5519/roles/87a7ef7c55854edb887513f9e471440c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.038303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d3a3833a-f3c3-4a9f-a125-87d8b3efae51 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:46.039184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.041949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d3a3833a-f3c3-4a9f-a125-87d8b3efae51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:46.054358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce0a76-c971-4e6d-b071-a9b9d75fa431 None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=2393ed59b5e74a99ae55f15bdc2b5519, role_id=87a7ef7c55854edb887513f9e471440c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.056664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce0a76-c971-4e6d-b071-a9b9d75fa431 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.064814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.132482 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 415/833] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:24:46.154066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3833a-f3c3-4a9f-a125-87d8b3efae51 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.251340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3833a-f3c3-4a9f-a125-87d8b3efae51 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.285168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff7cba-4c7e-42c9-a480-e11f51549193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.285993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff7cba-4c7e-42c9-a480-e11f51549193 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.286280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff7cba-4c7e-42c9-a480-e11f51549193 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.286556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff7cba-4c7e-42c9-a480-e11f51549193 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.287234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff7cba-4c7e-42c9-a480-e11f51549193 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.288604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff7cba-4c7e-42c9-a480-e11f51549193 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e6ff7cba-4c7e-42c9-a480-e11f51549193 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:46.300040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:46.301265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:46.302180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 416/834] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:46.303027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2394e-f6c7-4ca5-bb57-58ec7556152a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.303027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2394e-f6c7-4ca5-bb57-58ec7556152a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.303412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2394e-f6c7-4ca5-bb57-58ec7556152a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.304668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 417/835] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:46.307301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2394e-f6c7-4ca5-bb57-58ec7556152a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.406726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2394e-f6c7-4ca5-bb57-58ec7556152a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.438338 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 419/836] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:24:45 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/2393ed59b5e74a99ae55f15bdc2b5519/roles/87a7ef7c55854edb887513f9e471440c => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:46.451276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84d815-0978-4b76-820e-a5522d64327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.451276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d815-0978-4b76-820e-a5522d64327c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.451276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d815-0978-4b76-820e-a5522d64327c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.451276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d815-0978-4b76-820e-a5522d64327c None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.451628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84d815-0978-4b76-820e-a5522d64327c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:46.451628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84d815-0978-4b76-820e-a5522d64327c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.451628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84d815-0978-4b76-820e-a5522d64327c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.451628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 418/837] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:46.451628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863d8b6-2de1-4246-ae2d-d0d4d10cd317 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.451628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863d8b6-2de1-4246-ae2d-d0d4d10cd317 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.452547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863d8b6-2de1-4246-ae2d-d0d4d10cd317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.455601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce0a76-c971-4e6d-b071-a9b9d75fa431 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.462520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.477748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a863d8b6-2de1-4246-ae2d-d0d4d10cd317 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:46.479093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a863d8b6-2de1-4246-ae2d-d0d4d10cd317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:46.576642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce0a76-c971-4e6d-b071-a9b9d75fa431 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.577258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 419/838] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:46.599062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863d8b6-2de1-4246-ae2d-d0d4d10cd317 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.608714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.622501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954af7cc-e1ef-47b5-b9f4-57eca9c318a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.623819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954af7cc-e1ef-47b5-b9f4-57eca9c318a0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.624833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954af7cc-e1ef-47b5-b9f4-57eca9c318a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.625322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954af7cc-e1ef-47b5-b9f4-57eca9c318a0 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.626375 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954af7cc-e1ef-47b5-b9f4-57eca9c318a0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:46.626748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954af7cc-e1ef-47b5-b9f4-57eca9c318a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.628428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954af7cc-e1ef-47b5-b9f4-57eca9c318a0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.636629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 420/839] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:46.736346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863d8b6-2de1-4246-ae2d-d0d4d10cd317 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.776027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370cbb6-d347-4af2-a489-730b1fd5793d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.776865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370cbb6-d347-4af2-a489-730b1fd5793d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.777152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370cbb6-d347-4af2-a489-730b1fd5793d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.777433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370cbb6-d347-4af2-a489-730b1fd5793d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.778137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370cbb6-d347-4af2-a489-730b1fd5793d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.779560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370cbb6-d347-4af2-a489-730b1fd5793d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e370cbb6-d347-4af2-a489-730b1fd5793d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:46.793161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:46.794194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:46.795002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 420/840] 10.222.0.41 () {56 vars in 1132 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:46.801412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954af7cc-e1ef-47b5-b9f4-57eca9c318a0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.856393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.909350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954af7cc-e1ef-47b5-b9f4-57eca9c318a0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.944795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64909061-cf1f-4a18-a9da-8997b015059b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.945526 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909061-cf1f-4a18-a9da-8997b015059b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.945856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909061-cf1f-4a18-a9da-8997b015059b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.946189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64909061-cf1f-4a18-a9da-8997b015059b None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.946909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64909061-cf1f-4a18-a9da-8997b015059b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:46.947224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64909061-cf1f-4a18-a9da-8997b015059b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.948601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64909061-cf1f-4a18-a9da-8997b015059b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.953557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 421/841] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:46.959122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370cbb6-d347-4af2-a489-730b1fd5793d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.032366 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.063687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370cbb6-d347-4af2-a489-730b1fd5793d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.098190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103bcac0-0f08-49f4-b92c-146c9cab9b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.099259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bcac0-0f08-49f4-b92c-146c9cab9b1a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.099545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bcac0-0f08-49f4-b92c-146c9cab9b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.099823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103bcac0-0f08-49f4-b92c-146c9cab9b1a None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.100540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bcac0-0f08-49f4-b92c-146c9cab9b1a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:47.100849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bcac0-0f08-49f4-b92c-146c9cab9b1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.102370 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103bcac0-0f08-49f4-b92c-146c9cab9b1a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.107410 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 421/842] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:47.776371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec6c6-413e-40a2-b438-7d55fb8a0bd8 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.776761 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec6c6-413e-40a2-b438-7d55fb8a0bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.776973 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ec6c6-413e-40a2-b438-7d55fb8a0bd8 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.778678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 422/843] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:47.788329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c6709-2a68-413f-86e5-0173ad74e910 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.788914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c6709-2a68-413f-86e5-0173ad74e910 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.789409 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c6709-2a68-413f-86e5-0173ad74e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.807162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5f3c6709-2a68-413f-86e5-0173ad74e910 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:47.808652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5f3c6709-2a68-413f-86e5-0173ad74e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:47.878564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 422/844] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:47.902487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ec6c6-413e-40a2-b438-7d55fb8a0bd8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.006808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ec6c6-413e-40a2-b438-7d55fb8a0bd8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.021980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.041952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da974d3-f344-4c4a-b5bb-b2bebbac8344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.042675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da974d3-f344-4c4a-b5bb-b2bebbac8344 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.042961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da974d3-f344-4c4a-b5bb-b2bebbac8344 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.043236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da974d3-f344-4c4a-b5bb-b2bebbac8344 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.054120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da974d3-f344-4c4a-b5bb-b2bebbac8344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7da974d3-f344-4c4a-b5bb-b2bebbac8344 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:48.061925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:48.062834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:48.063658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 423/845] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:48.069199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c6709-2a68-413f-86e5-0173ad74e910 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.130731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.168687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c6709-2a68-413f-86e5-0173ad74e910 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.203922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aeff70-96ca-460b-8030-2758b3955594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.204593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeff70-96ca-460b-8030-2758b3955594 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.204876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeff70-96ca-460b-8030-2758b3955594 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.205155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeff70-96ca-460b-8030-2758b3955594 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.205926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aeff70-96ca-460b-8030-2758b3955594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:48.206237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aeff70-96ca-460b-8030-2758b3955594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.207605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aeff70-96ca-460b-8030-2758b3955594 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.216219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 423/846] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:48.221618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da974d3-f344-4c4a-b5bb-b2bebbac8344 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.337874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da974d3-f344-4c4a-b5bb-b2bebbac8344 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.372947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81346da4-ddd4-4619-b26f-fc2597c18ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.374665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81346da4-ddd4-4619-b26f-fc2597c18ddb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.375168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81346da4-ddd4-4619-b26f-fc2597c18ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.375661 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81346da4-ddd4-4619-b26f-fc2597c18ddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.386999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81346da4-ddd4-4619-b26f-fc2597c18ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.388829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81346da4-ddd4-4619-b26f-fc2597c18ddb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-81346da4-ddd4-4619-b26f-fc2597c18ddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:48.407228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:48.408152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:48.409001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:48.409001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:48.409001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:48.409001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:48.411367 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 424/847] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:48.417201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aeff70-96ca-460b-8030-2758b3955594 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.524236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aeff70-96ca-460b-8030-2758b3955594 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.550477 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.558178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ad985-64e2-4e37-9dd2-1ad63634a1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.558849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ad985-64e2-4e37-9dd2-1ad63634a1cc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.559132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ad985-64e2-4e37-9dd2-1ad63634a1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.559405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ad985-64e2-4e37-9dd2-1ad63634a1cc None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.560188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ad985-64e2-4e37-9dd2-1ad63634a1cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:48.560526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ad985-64e2-4e37-9dd2-1ad63634a1cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.562412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ad985-64e2-4e37-9dd2-1ad63634a1cc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.574655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 424/848] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:48.580435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81346da4-ddd4-4619-b26f-fc2597c18ddb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.614618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.689769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81346da4-ddd4-4619-b26f-fc2597c18ddb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.724637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396a8b2-39d0-4278-8558-2e5e829dceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.725468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a8b2-39d0-4278-8558-2e5e829dceca None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.725787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a8b2-39d0-4278-8558-2e5e829dceca None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.726070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a8b2-39d0-4278-8558-2e5e829dceca None admin] PATH_INFO: `/v3/users/swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.735809 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396a8b2-39d0-4278-8558-2e5e829dceca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.737403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396a8b2-39d0-4278-8558-2e5e829dceca None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9396a8b2-39d0-4278-8558-2e5e829dceca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:48.753617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:48.754636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:48.755561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 425/849] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:48.761277 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ad985-64e2-4e37-9dd2-1ad63634a1cc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.796445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cabb5-fa0f-4148-a9d0-4aab190b0d3e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.796821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cabb5-fa0f-4148-a9d0-4aab190b0d3e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.797019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cabb5-fa0f-4148-a9d0-4aab190b0d3e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.798411 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 426/850] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:48.806643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cbf6c-a5fe-4e31-8646-bb164c62b034 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.807231 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cbf6c-a5fe-4e31-8646-bb164c62b034 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.807782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cbf6c-a5fe-4e31-8646-bb164c62b034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.826188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a55cbf6c-a5fe-4e31-8646-bb164c62b034 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:48.828455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a55cbf6c-a5fe-4e31-8646-bb164c62b034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:48.880884 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ad985-64e2-4e37-9dd2-1ad63634a1cc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.911535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 427/851] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:48.921738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6cb8b-5d1a-4b3e-ba81-4afc0bdb121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.922433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6cb8b-5d1a-4b3e-ba81-4afc0bdb121c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.922723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6cb8b-5d1a-4b3e-ba81-4afc0bdb121c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.923005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6cb8b-5d1a-4b3e-ba81-4afc0bdb121c None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.923859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6cb8b-5d1a-4b3e-ba81-4afc0bdb121c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:48.924266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6cb8b-5d1a-4b3e-ba81-4afc0bdb121c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.926819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6cb8b-5d1a-4b3e-ba81-4afc0bdb121c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.927284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b0bc0-344a-45f3-bdde-7675d2168a37 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.927578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b0bc0-344a-45f3-bdde-7675d2168a37 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.927857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b0bc0-344a-45f3-bdde-7675d2168a37 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.930599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 428/852] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:48.932437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b0bc0-344a-45f3-bdde-7675d2168a37 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.947764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 425/853] 10.222.0.41 () {56 vars in 1135 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:48.949031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82ffd7-904e-4099-90c7-54441e7ff8af None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.949319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82ffd7-904e-4099-90c7-54441e7ff8af None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.949596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82ffd7-904e-4099-90c7-54441e7ff8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.957281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.966272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8b82ffd7-904e-4099-90c7-54441e7ff8af None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:48.967537 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8b82ffd7-904e-4099-90c7-54441e7ff8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:49.008239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.039229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 426/854] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:49.040540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82ffd7-904e-4099-90c7-54441e7ff8af None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.056192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b0bc0-344a-45f3-bdde-7675d2168a37 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.095728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319dad9-b602-456c-ae1e-f0ff0aaaaef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.096639 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319dad9-b602-456c-ae1e-f0ff0aaaaef6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.096927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319dad9-b602-456c-ae1e-f0ff0aaaaef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.097200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319dad9-b602-456c-ae1e-f0ff0aaaaef6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.109327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319dad9-b602-456c-ae1e-f0ff0aaaaef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6319dad9-b602-456c-ae1e-f0ff0aaaaef6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:49.116980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:49.118197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 429/855] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:49.122995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319dad9-b602-456c-ae1e-f0ff0aaaaef6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.162634 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82ffd7-904e-4099-90c7-54441e7ff8af None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.200927 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c504087-fe14-45b4-9e7d-97ef1a03cc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.201590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.202577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504087-fe14-45b4-9e7d-97ef1a03cc39 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.202868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504087-fe14-45b4-9e7d-97ef1a03cc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.203144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c504087-fe14-45b4-9e7d-97ef1a03cc39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.230717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319dad9-b602-456c-ae1e-f0ff0aaaaef6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.255644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.273699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d99e5e-f15e-4388-8651-05f6c214ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.274370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99e5e-f15e-4388-8651-05f6c214ecd7 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.274659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99e5e-f15e-4388-8651-05f6c214ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.274943 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d99e5e-f15e-4388-8651-05f6c214ecd7 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.275692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d99e5e-f15e-4388-8651-05f6c214ecd7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.277063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d99e5e-f15e-4388-8651-05f6c214ecd7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.282698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504087-fe14-45b4-9e7d-97ef1a03cc39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.284197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c504087-fe14-45b4-9e7d-97ef1a03cc39 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.341708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 430/856] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:24:49 2022] POST /identity/v3/services => generated 251 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:49.342106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d99e5e-f15e-4388-8651-05f6c214ecd7 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.398390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 427/857] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:24:49.405363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c504087-fe14-45b4-9e7d-97ef1a03cc39 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.493301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d99e5e-f15e-4388-8651-05f6c214ecd7 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.494000 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.522246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c504087-fe14-45b4-9e7d-97ef1a03cc39 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.526607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.536838 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d824418-4527-4fa7-8b3b-676078c31084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.537526 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d824418-4527-4fa7-8b3b-676078c31084 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.537847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d824418-4527-4fa7-8b3b-676078c31084 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.538130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d824418-4527-4fa7-8b3b-676078c31084 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.538886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d824418-4527-4fa7-8b3b-676078c31084 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:49.539237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d824418-4527-4fa7-8b3b-676078c31084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.540725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d824418-4527-4fa7-8b3b-676078c31084 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.551847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 431/858] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:49.553196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae5c76-a9c1-40ea-a929-2b091e970cdd None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.553489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae5c76-a9c1-40ea-a929-2b091e970cdd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.553794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae5c76-a9c1-40ea-a929-2b091e970cdd None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.559630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 432/859] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:49.560497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae5c76-a9c1-40ea-a929-2b091e970cdd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.565325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1450d0-d942-463d-9809-d710ce3da9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.566212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1450d0-d942-463d-9809-d710ce3da9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.566501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1450d0-d942-463d-9809-d710ce3da9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.566782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1450d0-d942-463d-9809-d710ce3da9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.579134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1450d0-d942-463d-9809-d710ce3da9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.580603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1450d0-d942-463d-9809-d710ce3da9e4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7a1450d0-d942-463d-9809-d710ce3da9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:49.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:49.603496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:49.604558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:49.604558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:49.604558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:49.604558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:49.605749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 428/860] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:49.607115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde367-28f6-47f6-b16f-96caad3a461b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.607498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde367-28f6-47f6-b16f-96caad3a461b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.607885 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fde367-28f6-47f6-b16f-96caad3a461b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.626708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-42fde367-28f6-47f6-b16f-96caad3a461b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:49.627899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-42fde367-28f6-47f6-b16f-96caad3a461b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:49.682354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae5c76-a9c1-40ea-a929-2b091e970cdd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.701738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 429/861] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:49.701738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fde367-28f6-47f6-b16f-96caad3a461b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.734642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02502af6-0dff-4965-9142-a898a69d5d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.735581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02502af6-0dff-4965-9142-a898a69d5d14 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.735877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02502af6-0dff-4965-9142-a898a69d5d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.736213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02502af6-0dff-4965-9142-a898a69d5d14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.747287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02502af6-0dff-4965-9142-a898a69d5d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.749230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02502af6-0dff-4965-9142-a898a69d5d14 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.761117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-02502af6-0dff-4965-9142-a898a69d5d14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:49.767880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:49.768737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:49.769605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:49.769605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:49.769605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:49.769605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:49.769605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 433/862] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:49.770459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02502af6-0dff-4965-9142-a898a69d5d14 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.812381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fde367-28f6-47f6-b16f-96caad3a461b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.821280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:49.850301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee22576-ae72-473d-b867-0117d9db708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.850977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee22576-ae72-473d-b867-0117d9db708f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.851267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee22576-ae72-473d-b867-0117d9db708f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.851537 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee22576-ae72-473d-b867-0117d9db708f None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.852689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee22576-ae72-473d-b867-0117d9db708f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:49.852689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee22576-ae72-473d-b867-0117d9db708f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.853978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee22576-ae72-473d-b867-0117d9db708f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.866791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 430/863] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:49.867697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee22576-ae72-473d-b867-0117d9db708f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:49.883871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02502af6-0dff-4965-9142-a898a69d5d14 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.919150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd9f2b-3fbe-46ec-b820-718926cc45f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:49.919814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd9f2b-3fbe-46ec-b820-718926cc45f1 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.920094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd9f2b-3fbe-46ec-b820-718926cc45f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.920374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cd9f2b-3fbe-46ec-b820-718926cc45f1 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.921656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd9f2b-3fbe-46ec-b820-718926cc45f1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:49.923055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cd9f2b-3fbe-46ec-b820-718926cc45f1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:49.980176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee22576-ae72-473d-b867-0117d9db708f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:49.996578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.019762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff6ce3-5b0b-4c32-ad51-980bf2ec96ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.019762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6ce3-5b0b-4c32-ad51-980bf2ec96ce None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.019762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6ce3-5b0b-4c32-ad51-980bf2ec96ce None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.019762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff6ce3-5b0b-4c32-ad51-980bf2ec96ce None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.020413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff6ce3-5b0b-4c32-ad51-980bf2ec96ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:50.020413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff6ce3-5b0b-4c32-ad51-980bf2ec96ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.020413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff6ce3-5b0b-4c32-ad51-980bf2ec96ce None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.030055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 434/864] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:24:49 2022] POST /identity/v3/services => generated 269 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:50.030055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd9f2b-3fbe-46ec-b820-718926cc45f1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.031615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 431/865] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:50.036959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff6ce3-5b0b-4c32-ad51-980bf2ec96ce None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.154669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff6ce3-5b0b-4c32-ad51-980bf2ec96ce None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.191974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.196701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cd9f2b-3fbe-46ec-b820-718926cc45f1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.204145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117633ca-d737-4f17-ab91-1ca18dc24bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.206426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117633ca-d737-4f17-ab91-1ca18dc24bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.206947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117633ca-d737-4f17-ab91-1ca18dc24bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.207427 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117633ca-d737-4f17-ab91-1ca18dc24bf7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.218215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117633ca-d737-4f17-ab91-1ca18dc24bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.220572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117633ca-d737-4f17-ab91-1ca18dc24bf7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.237889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf6b64-1467-448b-bc30-1fd33b222601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.239578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf6b64-1467-448b-bc30-1fd33b222601 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.239578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf6b64-1467-448b-bc30-1fd33b222601 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.239578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf6b64-1467-448b-bc30-1fd33b222601 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-117633ca-d737-4f17-ab91-1ca18dc24bf7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:50.241870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:50.242746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:50.243694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 432/866] 10.222.0.41 () {56 vars in 1117 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:50.247982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf6b64-1467-448b-bc30-1fd33b222601 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.249417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117633ca-d737-4f17-ab91-1ca18dc24bf7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.249688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf6b64-1467-448b-bc30-1fd33b222601 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e9cf6b64-1467-448b-bc30-1fd33b222601 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:50.268491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:50.269403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:50.270391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:50.270391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:50.270391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:50.270391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:50.270391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:50.270391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:50.270391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:50.270391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:50.270391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 435/867] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:50.275566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf6b64-1467-448b-bc30-1fd33b222601 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.290021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.384021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117633ca-d737-4f17-ab91-1ca18dc24bf7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.398240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf6b64-1467-448b-bc30-1fd33b222601 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.431181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f345b0-2b8b-4e06-9e6b-10701c973314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.431861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f345b0-2b8b-4e06-9e6b-10701c973314 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.432395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f345b0-2b8b-4e06-9e6b-10701c973314 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.432676 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f345b0-2b8b-4e06-9e6b-10701c973314 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.433511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f345b0-2b8b-4e06-9e6b-10701c973314 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:50.434100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f345b0-2b8b-4e06-9e6b-10701c973314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.436742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f345b0-2b8b-4e06-9e6b-10701c973314 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.441455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010e47a-1f02-4fe2-b023-bf90dfcf3c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.442368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010e47a-1f02-4fe2-b023-bf90dfcf3c39 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.442849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010e47a-1f02-4fe2-b023-bf90dfcf3c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.443298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010e47a-1f02-4fe2-b023-bf90dfcf3c39 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.444538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010e47a-1f02-4fe2-b023-bf90dfcf3c39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:50.445031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010e47a-1f02-4fe2-b023-bf90dfcf3c39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.447639 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010e47a-1f02-4fe2-b023-bf90dfcf3c39 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.457748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 433/868] 10.222.0.41 () {56 vars in 1149 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:50.462607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f345b0-2b8b-4e06-9e6b-10701c973314 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.473408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 436/869] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:50.474703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010e47a-1f02-4fe2-b023-bf90dfcf3c39 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.505581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.582386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.596211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f345b0-2b8b-4e06-9e6b-10701c973314 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.597060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010e47a-1f02-4fe2-b023-bf90dfcf3c39 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.635450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eaf19-f2eb-46fa-a17c-767eafcea0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.636116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eaf19-f2eb-46fa-a17c-767eafcea0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.636492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eaf19-f2eb-46fa-a17c-767eafcea0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.636776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9eaf19-f2eb-46fa-a17c-767eafcea0c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.637606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eaf19-f2eb-46fa-a17c-767eafcea0c4 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=af5ebb39734144418fe35f9f0a679145) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:50.637995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eaf19-f2eb-46fa-a17c-767eafcea0c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.639983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9eaf19-f2eb-46fa-a17c-767eafcea0c4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.641305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b74317-4c18-476c-9a70-aac8e4c668e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.642251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b74317-4c18-476c-9a70-aac8e4c668e0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.642585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b74317-4c18-476c-9a70-aac8e4c668e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.643442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b74317-4c18-476c-9a70-aac8e4c668e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.646646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 437/870] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/role_assignments?user.id=af5ebb39734144418fe35f9f0a679145&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:50.723163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b74317-4c18-476c-9a70-aac8e4c668e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.724715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b74317-4c18-476c-9a70-aac8e4c668e0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.826499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.841863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 434/871] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:24:50.842025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eaf19-f2eb-46fa-a17c-767eafcea0c4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.937321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.953357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9eaf19-f2eb-46fa-a17c-767eafcea0c4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.988205 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d10f5-9375-41db-a951-df9959970427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.988994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d10f5-9375-41db-a951-df9959970427 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.989280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d10f5-9375-41db-a951-df9959970427 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.989557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d10f5-9375-41db-a951-df9959970427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.000183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d10f5-9375-41db-a951-df9959970427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.001609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d10f5-9375-41db-a951-df9959970427 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a71d10f5-9375-41db-a951-df9959970427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:51.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:51.020665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:51.021519 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:51.021519 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:51.021519 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:51.021519 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:51.021519 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 438/872] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:51.026759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b74317-4c18-476c-9a70-aac8e4c668e0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.141543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b74317-4c18-476c-9a70-aac8e4c668e0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.176408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12755b7d-0493-4baf-b5d8-be8dcd0ee808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.177372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755b7d-0493-4baf-b5d8-be8dcd0ee808 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.177847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755b7d-0493-4baf-b5d8-be8dcd0ee808 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.178279 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12755b7d-0493-4baf-b5d8-be8dcd0ee808 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.179141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12755b7d-0493-4baf-b5d8-be8dcd0ee808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.179594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12755b7d-0493-4baf-b5d8-be8dcd0ee808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.181115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12755b7d-0493-4baf-b5d8-be8dcd0ee808 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.198414 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 435/873] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.199768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d10f5-9375-41db-a951-df9959970427 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.313516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d10f5-9375-41db-a951-df9959970427 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.350506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c10043-e8ed-405f-8696-ae2c9dcd3793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.351682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c10043-e8ed-405f-8696-ae2c9dcd3793 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.352171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c10043-e8ed-405f-8696-ae2c9dcd3793 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.352675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c10043-e8ed-405f-8696-ae2c9dcd3793 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.360652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c10043-e8ed-405f-8696-ae2c9dcd3793 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.362400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c10043-e8ed-405f-8696-ae2c9dcd3793 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-20c10043-e8ed-405f-8696-ae2c9dcd3793 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:51.376599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:51.377448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:51.378425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:51.378425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:51.378425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:51.378425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:51.378425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:51.378425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:51.378425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:51.378425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:51.380854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 439/874] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:51.385518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.390741 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12755b7d-0493-4baf-b5d8-be8dcd0ee808 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.478146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.501101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12755b7d-0493-4baf-b5d8-be8dcd0ee808 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.536446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad59c65-0770-4b24-bec0-2ee3a19d0e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.537489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad59c65-0770-4b24-bec0-2ee3a19d0e0c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.537986 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad59c65-0770-4b24-bec0-2ee3a19d0e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.538441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad59c65-0770-4b24-bec0-2ee3a19d0e0c None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.539419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad59c65-0770-4b24-bec0-2ee3a19d0e0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.539907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad59c65-0770-4b24-bec0-2ee3a19d0e0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.541531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad59c65-0770-4b24-bec0-2ee3a19d0e0c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.554917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 436/875] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.560892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c10043-e8ed-405f-8696-ae2c9dcd3793 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.623614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb628-78c4-471c-ba1c-b5b10072863a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.624043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb628-78c4-471c-ba1c-b5b10072863a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.624419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eeb628-78c4-471c-ba1c-b5b10072863a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.626121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 437/876] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:51.631002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f7f9-92e3-45c8-8ff6-868bd4a7ff1e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.631379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f7f9-92e3-45c8-8ff6-868bd4a7ff1e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.631734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782f7f9-92e3-45c8-8ff6-868bd4a7ff1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.649064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9782f7f9-92e3-45c8-8ff6-868bd4a7ff1e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:51.650445 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9782f7f9-92e3-45c8-8ff6-868bd4a7ff1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:51.677189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c10043-e8ed-405f-8696-ae2c9dcd3793 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.720530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad951dc7-2976-4cd4-93a0-63038387c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.721480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad951dc7-2976-4cd4-93a0-63038387c19e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.721989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad951dc7-2976-4cd4-93a0-63038387c19e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.722431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad951dc7-2976-4cd4-93a0-63038387c19e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.723418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad951dc7-2976-4cd4-93a0-63038387c19e None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=2393ed59b5e74a99ae55f15bdc2b5519) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.723912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad951dc7-2976-4cd4-93a0-63038387c19e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.725501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad951dc7-2976-4cd4-93a0-63038387c19e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.726085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 438/877] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:24:51.732426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 440/878] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/role_assignments?user.id=2393ed59b5e74a99ae55f15bdc2b5519&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:51.743591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782f7f9-92e3-45c8-8ff6-868bd4a7ff1e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.795929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.860088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782f7f9-92e3-45c8-8ff6-868bd4a7ff1e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.900444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297b0cf-79f9-4981-a2a6-67c46767f4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.901286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b0cf-79f9-4981-a2a6-67c46767f4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.901573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b0cf-79f9-4981-a2a6-67c46767f4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.901887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297b0cf-79f9-4981-a2a6-67c46767f4b4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.902566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297b0cf-79f9-4981-a2a6-67c46767f4b4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.903983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2297b0cf-79f9-4981-a2a6-67c46767f4b4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-2297b0cf-79f9-4981-a2a6-67c46767f4b4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:51.917479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:51.918548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:51.919375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 439/879] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:51.926818 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad951dc7-2976-4cd4-93a0-63038387c19e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.995467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.037935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad951dc7-2976-4cd4-93a0-63038387c19e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.076541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a8923-3d21-4ff1-81b7-6481516290bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.077631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8923-3d21-4ff1-81b7-6481516290bb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.077631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8923-3d21-4ff1-81b7-6481516290bb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.077837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a8923-3d21-4ff1-81b7-6481516290bb None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.079977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a8923-3d21-4ff1-81b7-6481516290bb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:52.079977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a8923-3d21-4ff1-81b7-6481516290bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.080138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a8923-3d21-4ff1-81b7-6481516290bb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.085863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 441/880] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:52.091141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297b0cf-79f9-4981-a2a6-67c46767f4b4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.202339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2297b0cf-79f9-4981-a2a6-67c46767f4b4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.205103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.242209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6827a-3184-4bdd-b616-f35b0e127413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.243351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6827a-3184-4bdd-b616-f35b0e127413 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.243934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6827a-3184-4bdd-b616-f35b0e127413 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.244423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6827a-3184-4bdd-b616-f35b0e127413 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.245657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6827a-3184-4bdd-b616-f35b0e127413 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:52.246212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6827a-3184-4bdd-b616-f35b0e127413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.247889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6827a-3184-4bdd-b616-f35b0e127413 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.253470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 440/881] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:52.262069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a8923-3d21-4ff1-81b7-6481516290bb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.362307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb8a7b-538a-4b0a-b8c4-f482980a575e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.362914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb8a7b-538a-4b0a-b8c4-f482980a575e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.363583 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb8a7b-538a-4b0a-b8c4-f482980a575e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.366081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 441/882] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:52.368745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a8923-3d21-4ff1-81b7-6481516290bb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.371943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d98245-4c33-440f-b0b7-6d135f53efca None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.372408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d98245-4c33-440f-b0b7-6d135f53efca None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.372790 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d98245-4c33-440f-b0b7-6d135f53efca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.393425 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-80d98245-4c33-440f-b0b7-6d135f53efca None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:52.394986 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-80d98245-4c33-440f-b0b7-6d135f53efca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:52.396383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.406274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6818-2089-4760-b0c5-1de5f6b28fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.406952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6818-2089-4760-b0c5-1de5f6b28fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.407346 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6818-2089-4760-b0c5-1de5f6b28fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.407529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea6818-2089-4760-b0c5-1de5f6b28fb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.408409 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea6818-2089-4760-b0c5-1de5f6b28fb6 None admin] RBAC: Adding query filter params (interface=public, service_id=65111e46fa924d3688e35bd34a41979f, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:52.408743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea6818-2089-4760-b0c5-1de5f6b28fb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.410207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea6818-2089-4760-b0c5-1de5f6b28fb6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.415914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 442/883] 10.222.0.41 () {56 vars in 1251 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/endpoints?service_id=65111e46fa924d3688e35bd34a41979f&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:52.421848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6818-2089-4760-b0c5-1de5f6b28fb6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.497904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 442/884] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:52.519151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d98245-4c33-440f-b0b7-6d135f53efca None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.543116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea6818-2089-4760-b0c5-1de5f6b28fb6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.592005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc80674-dab3-4923-b9b3-ca53ff659ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.593317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80674-dab3-4923-b9b3-ca53ff659ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.594061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80674-dab3-4923-b9b3-ca53ff659ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.594941 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc80674-dab3-4923-b9b3-ca53ff659ce3 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.596112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc80674-dab3-4923-b9b3-ca53ff659ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.597739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc80674-dab3-4923-b9b3-ca53ff659ce3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.614333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 443/885] 10.222.0.41 () {56 vars in 1087 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/services => generated 1268 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:24:52.640532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.644484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d98245-4c33-440f-b0b7-6d135f53efca None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.682491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dc73f-8f15-4e3a-8182-4663cbce23d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.683394 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dc73f-8f15-4e3a-8182-4663cbce23d4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.683689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dc73f-8f15-4e3a-8182-4663cbce23d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.684024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dc73f-8f15-4e3a-8182-4663cbce23d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.684704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dc73f-8f15-4e3a-8182-4663cbce23d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.686263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dc73f-8f15-4e3a-8182-4663cbce23d4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5a0dc73f-8f15-4e3a-8182-4663cbce23d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:52.700475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:52.702199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:24:52.703068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:52.707498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 443/886] 10.222.0.41 () {56 vars in 1132 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:52.714013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc80674-dab3-4923-b9b3-ca53ff659ce3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.773829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.827474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc80674-dab3-4923-b9b3-ca53ff659ce3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.870642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987dac1-42bd-4fc6-a4b5-7f670d5489ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.871692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987dac1-42bd-4fc6-a4b5-7f670d5489ad None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.872181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987dac1-42bd-4fc6-a4b5-7f670d5489ad None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.872803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987dac1-42bd-4fc6-a4b5-7f670d5489ad None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.874026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987dac1-42bd-4fc6-a4b5-7f670d5489ad None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:52.874562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987dac1-42bd-4fc6-a4b5-7f670d5489ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.876199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987dac1-42bd-4fc6-a4b5-7f670d5489ad None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.882503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 444/887] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:52.888160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dc73f-8f15-4e3a-8182-4663cbce23d4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.996131 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dc73f-8f15-4e3a-8182-4663cbce23d4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.041783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b5221-640b-4bfd-ad8c-95ac7f34fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.041783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b5221-640b-4bfd-ad8c-95ac7f34fd8d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.041783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b5221-640b-4bfd-ad8c-95ac7f34fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.041783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b5221-640b-4bfd-ad8c-95ac7f34fd8d None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.042191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b5221-640b-4bfd-ad8c-95ac7f34fd8d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:53.042191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b5221-640b-4bfd-ad8c-95ac7f34fd8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.042191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b5221-640b-4bfd-ad8c-95ac7f34fd8d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.048931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27dea-aa86-4fae-b107-7bb5599bbaa1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.049226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27dea-aa86-4fae-b107-7bb5599bbaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.049510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd27dea-aa86-4fae-b107-7bb5599bbaa1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.049923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 444/888] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:53.050967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 445/889] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:53.055932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf828dc-f6b0-40d0-84ac-1f615ba8bb51 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.056223 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf828dc-f6b0-40d0-84ac-1f615ba8bb51 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.056509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf828dc-f6b0-40d0-84ac-1f615ba8bb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.057276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b5221-640b-4bfd-ad8c-95ac7f34fd8d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.082212 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-faf828dc-f6b0-40d0-84ac-1f615ba8bb51 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:53.084159 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-faf828dc-f6b0-40d0-84ac-1f615ba8bb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:53.099440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.181867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b5221-640b-4bfd-ad8c-95ac7f34fd8d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.182208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 446/890] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:53.199554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf828dc-f6b0-40d0-84ac-1f615ba8bb51 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.216117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bb8a1-c382-4b0f-a220-cb5826cf5f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.217072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bb8a1-c382-4b0f-a220-cb5826cf5f2e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.217072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bb8a1-c382-4b0f-a220-cb5826cf5f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.217901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bb8a1-c382-4b0f-a220-cb5826cf5f2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.218918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bb8a1-c382-4b0f-a220-cb5826cf5f2e None admin] RBAC: Adding query filter params (interface=public, service_id=815c9f773dc04d4fa8342763d0eca51d, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:53.219152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bb8a1-c382-4b0f-a220-cb5826cf5f2e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.220534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bb8a1-c382-4b0f-a220-cb5826cf5f2e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.226412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 445/891] 10.222.0.41 () {56 vars in 1251 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/endpoints?service_id=815c9f773dc04d4fa8342763d0eca51d&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:53.231565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bb8a1-c382-4b0f-a220-cb5826cf5f2e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.255711 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.318222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf828dc-f6b0-40d0-84ac-1f615ba8bb51 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.345566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.354376 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dff830-efb6-48d8-afb8-e89df390edfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.355268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dff830-efb6-48d8-afb8-e89df390edfa None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.355613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dff830-efb6-48d8-afb8-e89df390edfa None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.356200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dff830-efb6-48d8-afb8-e89df390edfa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.357001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bb8a1-c382-4b0f-a220-cb5826cf5f2e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.360575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dff830-efb6-48d8-afb8-e89df390edfa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.360575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dff830-efb6-48d8-afb8-e89df390edfa None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e7dff830-efb6-48d8-afb8-e89df390edfa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:53.373389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:53.375013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:24:53.375821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:53.379377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 447/892] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:53.382012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dff830-efb6-48d8-afb8-e89df390edfa None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.399174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecb8d6-268a-4adc-a1f8-e5b3b8aec7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.400519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecb8d6-268a-4adc-a1f8-e5b3b8aec7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.401034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecb8d6-268a-4adc-a1f8-e5b3b8aec7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.401524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ecb8d6-268a-4adc-a1f8-e5b3b8aec7a8 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.402507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecb8d6-268a-4adc-a1f8-e5b3b8aec7a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.404102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ecb8d6-268a-4adc-a1f8-e5b3b8aec7a8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.417828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 446/893] 10.222.0.41 () {56 vars in 1087 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:24:53.504478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dff830-efb6-48d8-afb8-e89df390edfa None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.516618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.542413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b29f7-0fb1-4261-97ee-d6832cb445ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.543087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b29f7-0fb1-4261-97ee-d6832cb445ad None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.543371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b29f7-0fb1-4261-97ee-d6832cb445ad None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.543648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b29f7-0fb1-4261-97ee-d6832cb445ad None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.544555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b29f7-0fb1-4261-97ee-d6832cb445ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:53.544865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b29f7-0fb1-4261-97ee-d6832cb445ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.546808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b29f7-0fb1-4261-97ee-d6832cb445ad None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.552693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 448/894] 10.222.0.41 () {56 vars in 1122 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:53.558438 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecb8d6-268a-4adc-a1f8-e5b3b8aec7a8 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.664303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ecb8d6-268a-4adc-a1f8-e5b3b8aec7a8 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.700296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7184d-1f67-4330-a793-7f8c27293bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.700976 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7184d-1f67-4330-a793-7f8c27293bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.701259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7184d-1f67-4330-a793-7f8c27293bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.701535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7184d-1f67-4330-a793-7f8c27293bd5 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.702824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7184d-1f67-4330-a793-7f8c27293bd5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:53.703131 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7184d-1f67-4330-a793-7f8c27293bd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.704645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7184d-1f67-4330-a793-7f8c27293bd5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.709899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 447/895] 10.222.0.41 () {56 vars in 1122 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:54.169530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a372c32-9674-4a7e-b20a-8c1510ef65d9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.169880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a372c32-9674-4a7e-b20a-8c1510ef65d9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.170126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a372c32-9674-4a7e-b20a-8c1510ef65d9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.172323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 449/896] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:54.177439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82db899-4235-40f6-b7ae-15a300a18239 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.177767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82db899-4235-40f6-b7ae-15a300a18239 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.178052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82db899-4235-40f6-b7ae-15a300a18239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.195761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f82db899-4235-40f6-b7ae-15a300a18239 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:54.196944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f82db899-4235-40f6-b7ae-15a300a18239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:54.211871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.273434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 448/897] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:54.296052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a372c32-9674-4a7e-b20a-8c1510ef65d9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.402793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a372c32-9674-4a7e-b20a-8c1510ef65d9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.437464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efbe47-2829-448e-90bf-411a4e2d38f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.438315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efbe47-2829-448e-90bf-411a4e2d38f6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.438598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efbe47-2829-448e-90bf-411a4e2d38f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.438874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efbe47-2829-448e-90bf-411a4e2d38f6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.450023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efbe47-2829-448e-90bf-411a4e2d38f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a7efbe47-2829-448e-90bf-411a4e2d38f6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:54.458096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:54.459038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:54.460006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 450/898] 10.222.0.41 () {56 vars in 1120 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:54.465091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82db899-4235-40f6-b7ae-15a300a18239 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.568819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82db899-4235-40f6-b7ae-15a300a18239 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.604132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445559b1-f48d-40ef-8886-fcd0857a1331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.604805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445559b1-f48d-40ef-8886-fcd0857a1331 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.605094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445559b1-f48d-40ef-8886-fcd0857a1331 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.605375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445559b1-f48d-40ef-8886-fcd0857a1331 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.606174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445559b1-f48d-40ef-8886-fcd0857a1331 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:54.606489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445559b1-f48d-40ef-8886-fcd0857a1331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.607893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445559b1-f48d-40ef-8886-fcd0857a1331 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.617845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 449/899] 10.222.0.41 () {56 vars in 1115 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:54.623951 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efbe47-2829-448e-90bf-411a4e2d38f6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.664511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.725896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efbe47-2829-448e-90bf-411a4e2d38f6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.766546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1642787-2b43-49ce-b448-b25f25dabcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.767714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1642787-2b43-49ce-b448-b25f25dabcc7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.768270 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1642787-2b43-49ce-b448-b25f25dabcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.768886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1642787-2b43-49ce-b448-b25f25dabcc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.785109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1642787-2b43-49ce-b448-b25f25dabcc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.786606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1642787-2b43-49ce-b448-b25f25dabcc7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a1642787-2b43-49ce-b448-b25f25dabcc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:54.804637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:54.805599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:54.806491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:54.806491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:54.806491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:54.806491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:54.806491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 451/900] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:54.814746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445559b1-f48d-40ef-8886-fcd0857a1331 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.829646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.923618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445559b1-f48d-40ef-8886-fcd0857a1331 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.934369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceca075-ad3f-4d9e-9975-afb2ef057108 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.934662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceca075-ad3f-4d9e-9975-afb2ef057108 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.934950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceca075-ad3f-4d9e-9975-afb2ef057108 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.937117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 452/901] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:54.941862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1a712-e744-4e6e-96a9-5c326e7e8e3b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.942154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1a712-e744-4e6e-96a9-5c326e7e8e3b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.942435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1a712-e744-4e6e-96a9-5c326e7e8e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.959294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f165b-c3d4-4391-8783-1d60fde9e955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.959966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f165b-c3d4-4391-8783-1d60fde9e955 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.960254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f165b-c3d4-4391-8783-1d60fde9e955 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.960535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f165b-c3d4-4391-8783-1d60fde9e955 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.961262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f165b-c3d4-4391-8783-1d60fde9e955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:54.961573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f165b-c3d4-4391-8783-1d60fde9e955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.962167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-23b1a712-e744-4e6e-96a9-5c326e7e8e3b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:54.962982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f165b-c3d4-4391-8783-1d60fde9e955 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.963362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-23b1a712-e744-4e6e-96a9-5c326e7e8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:54.978157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 450/902] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:54.983511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f165b-c3d4-4391-8783-1d60fde9e955 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.053751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 453/903] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:24:55.070341 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.081226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1a712-e744-4e6e-96a9-5c326e7e8e3b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.111471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f165b-c3d4-4391-8783-1d60fde9e955 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.114023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.158149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333152f3-f965-41f7-99fb-a5e13a973345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.159275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333152f3-f965-41f7-99fb-a5e13a973345 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.159730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333152f3-f965-41f7-99fb-a5e13a973345 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.160150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333152f3-f965-41f7-99fb-a5e13a973345 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.170348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333152f3-f965-41f7-99fb-a5e13a973345 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.172323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333152f3-f965-41f7-99fb-a5e13a973345 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.190214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b1a712-e744-4e6e-96a9-5c326e7e8e3b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-333152f3-f965-41f7-99fb-a5e13a973345 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:24:55.191689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:55.192759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:55.193949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:55.193949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:55.193949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:24:55.193949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:24:55.193949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:24:55.193949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:24:55.193949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:24:55.193949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:24:55.193949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:24:55.193949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:55.200258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 451/904] 10.222.0.41 () {56 vars in 1117 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:55.201458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333152f3-f965-41f7-99fb-a5e13a973345 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.236155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41c0b-15a5-44c4-9499-ceca3e6107d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.238075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41c0b-15a5-44c4-9499-ceca3e6107d0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.238515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41c0b-15a5-44c4-9499-ceca3e6107d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.238942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41c0b-15a5-44c4-9499-ceca3e6107d0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.239754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41c0b-15a5-44c4-9499-ceca3e6107d0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.241351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41c0b-15a5-44c4-9499-ceca3e6107d0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6da41c0b-15a5-44c4-9499-ceca3e6107d0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:55.256850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:55.257945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:24:55.258770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:55.259502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 454/905] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:55.265815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41c0b-15a5-44c4-9499-ceca3e6107d0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.317782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333152f3-f965-41f7-99fb-a5e13a973345 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.349067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.356359 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da097159-3fa1-43f5-b5e6-521c1ddfac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.357825 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da097159-3fa1-43f5-b5e6-521c1ddfac0e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.357825 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da097159-3fa1-43f5-b5e6-521c1ddfac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.357825 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da097159-3fa1-43f5-b5e6-521c1ddfac0e None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.362355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da097159-3fa1-43f5-b5e6-521c1ddfac0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:55.362355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da097159-3fa1-43f5-b5e6-521c1ddfac0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.362355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da097159-3fa1-43f5-b5e6-521c1ddfac0e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.372402 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.387120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 452/906] 10.222.0.41 () {56 vars in 1149 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:55.390738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da097159-3fa1-43f5-b5e6-521c1ddfac0e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.395689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41c0b-15a5-44c4-9499-ceca3e6107d0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.439907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf712a-7eb7-47c2-a4ec-566ef9a35f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.441584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf712a-7eb7-47c2-a4ec-566ef9a35f3d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.442072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf712a-7eb7-47c2-a4ec-566ef9a35f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.442637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf712a-7eb7-47c2-a4ec-566ef9a35f3d None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.443783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf712a-7eb7-47c2-a4ec-566ef9a35f3d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:55.444263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf712a-7eb7-47c2-a4ec-566ef9a35f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.445797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf712a-7eb7-47c2-a4ec-566ef9a35f3d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.457930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 455/907] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:55.459561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf712a-7eb7-47c2-a4ec-566ef9a35f3d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.505155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da097159-3fa1-43f5-b5e6-521c1ddfac0e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.542202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e94e8-9c7d-419f-a00d-acbc49352b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.542851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e94e8-9c7d-419f-a00d-acbc49352b02 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.543133 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e94e8-9c7d-419f-a00d-acbc49352b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.543410 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e94e8-9c7d-419f-a00d-acbc49352b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.590138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf712a-7eb7-47c2-a4ec-566ef9a35f3d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.608828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.624448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e94e8-9c7d-419f-a00d-acbc49352b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.626619 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e94e8-9c7d-419f-a00d-acbc49352b02 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.639686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd84740-037f-4702-8e40-bf97528d7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.640637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd84740-037f-4702-8e40-bf97528d7089 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.640933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd84740-037f-4702-8e40-bf97528d7089 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.641217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd84740-037f-4702-8e40-bf97528d7089 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.641968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd84740-037f-4702-8e40-bf97528d7089 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:55.642280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd84740-037f-4702-8e40-bf97528d7089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.644222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd84740-037f-4702-8e40-bf97528d7089 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.653813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 456/908] 10.222.0.41 () {56 vars in 1114 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:55.657373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd84740-037f-4702-8e40-bf97528d7089 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.669909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.761425 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 453/909] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:24:55.768213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd84740-037f-4702-8e40-bf97528d7089 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.769309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e94e8-9c7d-419f-a00d-acbc49352b02 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.806689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3e1ed5-d040-4100-b8f8-1f88ed4fd467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.807385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e1ed5-d040-4100-b8f8-1f88ed4fd467 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.807677 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e1ed5-d040-4100-b8f8-1f88ed4fd467 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.807961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3e1ed5-d040-4100-b8f8-1f88ed4fd467 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.808719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e1ed5-d040-4100-b8f8-1f88ed4fd467 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.810188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3e1ed5-d040-4100-b8f8-1f88ed4fd467 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.864712 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.878166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 457/910] 10.222.0.41 () {60 vars in 1144 bytes} [Thu May 26 12:24:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:24:55.878166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221f844-86e8-48cc-9184-332dbe508497 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.878166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221f844-86e8-48cc-9184-332dbe508497 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.878166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221f844-86e8-48cc-9184-332dbe508497 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.878166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 458/911] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:55.882782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feee02-8355-4103-beb5-1a9c903ce156 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.883072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feee02-8355-4103-beb5-1a9c903ce156 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.883352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17feee02-8355-4103-beb5-1a9c903ce156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.890008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e94e8-9c7d-419f-a00d-acbc49352b02 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:55.906553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-17feee02-8355-4103-beb5-1a9c903ce156 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:55.908219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-17feee02-8355-4103-beb5-1a9c903ce156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:55.941182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3ebc-c5f6-4749-b29a-169afbe4c97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:55.942126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3ebc-c5f6-4749-b29a-169afbe4c97c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:55.942485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3ebc-c5f6-4749-b29a-169afbe4c97c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:55.942834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e3ebc-c5f6-4749-b29a-169afbe4c97c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:55.955417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3ebc-c5f6-4749-b29a-169afbe4c97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:55.957038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e3ebc-c5f6-4749-b29a-169afbe4c97c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-101e3ebc-c5f6-4749-b29a-169afbe4c97c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:55.982187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:55.983776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:55.984652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:55.984652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:55.984652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:55.984652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:55.989000 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 454/912] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:55.989976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:55.990883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3ebc-c5f6-4749-b29a-169afbe4c97c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:55.998877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 459/913] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:24:56.010979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2222389-2c50-433b-acd2-5a0534e633e9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.011274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2222389-2c50-433b-acd2-5a0534e633e9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.011623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2222389-2c50-433b-acd2-5a0534e633e9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.018300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 460/914] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:56.020198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886831-ad5c-4488-afb6-25ed1b144668 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.020488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886831-ad5c-4488-afb6-25ed1b144668 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.020771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2886831-ad5c-4488-afb6-25ed1b144668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.038520 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a2886831-ad5c-4488-afb6-25ed1b144668 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:56.039756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a2886831-ad5c-4488-afb6-25ed1b144668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:56.114670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e3ebc-c5f6-4749-b29a-169afbe4c97c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.125701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 461/915] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:56.125701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2886831-ad5c-4488-afb6-25ed1b144668 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:56.159850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404c4d8-b78e-42c3-b986-1c2c54988aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.160527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404c4d8-b78e-42c3-b986-1c2c54988aba None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.160816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404c4d8-b78e-42c3-b986-1c2c54988aba None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.161100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404c4d8-b78e-42c3-b986-1c2c54988aba None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.161868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404c4d8-b78e-42c3-b986-1c2c54988aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:56.162182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404c4d8-b78e-42c3-b986-1c2c54988aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.163573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404c4d8-b78e-42c3-b986-1c2c54988aba None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:56.166039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:56.175780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 455/916] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:56.176673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404c4d8-b78e-42c3-b986-1c2c54988aba None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:56.229127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2886831-ad5c-4488-afb6-25ed1b144668 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.254120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:56.267567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fab64-eefb-44a0-a2bf-a3bbd2426d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.267567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fab64-eefb-44a0-a2bf-a3bbd2426d93 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.267567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fab64-eefb-44a0-a2bf-a3bbd2426d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.267567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fab64-eefb-44a0-a2bf-a3bbd2426d93 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.268140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fab64-eefb-44a0-a2bf-a3bbd2426d93 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.269325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65fab64-eefb-44a0-a2bf-a3bbd2426d93 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a65fab64-eefb-44a0-a2bf-a3bbd2426d93 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:56.281464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:56.282453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:56.283260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 462/917] 10.222.0.41 () {56 vars in 1132 bytes} [Thu May 26 12:24:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:56.284072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fab64-eefb-44a0-a2bf-a3bbd2426d93 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:56.294485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404c4d8-b78e-42c3-b986-1c2c54988aba None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.332430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c4f62-ce84-4439-b114-95a89fa64fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.333211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c4f62-ce84-4439-b114-95a89fa64fe5 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.333375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c4f62-ce84-4439-b114-95a89fa64fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.333657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c4f62-ce84-4439-b114-95a89fa64fe5 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.334413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c4f62-ce84-4439-b114-95a89fa64fe5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.335791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69c4f62-ce84-4439-b114-95a89fa64fe5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:56.392316 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fab64-eefb-44a0-a2bf-a3bbd2426d93 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.392784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 456/918] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:24:56 2022] POST /identity/v3/services => generated 241 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:56.393616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c4f62-ce84-4439-b114-95a89fa64fe5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:56.454188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625f9b-631d-4ba1-9719-75dfaf6168b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.455434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625f9b-631d-4ba1-9719-75dfaf6168b6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.455434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625f9b-631d-4ba1-9719-75dfaf6168b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.455605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625f9b-631d-4ba1-9719-75dfaf6168b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.463984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625f9b-631d-4ba1-9719-75dfaf6168b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.465651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96625f9b-631d-4ba1-9719-75dfaf6168b6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:56.478152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-96625f9b-631d-4ba1-9719-75dfaf6168b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:56.482083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:56.483075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:56.483939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:56.483939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:56.483939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:56.483939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:56.483939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:56.483939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:56.483939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:56.483939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:56.483939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 463/919] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:56.489329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625f9b-631d-4ba1-9719-75dfaf6168b6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:56.543250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:56.554219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c4f62-ce84-4439-b114-95a89fa64fe5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.607244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625f9b-631d-4ba1-9719-75dfaf6168b6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.607564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf032903-8b5b-4501-b71e-d2d253038b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.608319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf032903-8b5b-4501-b71e-d2d253038b5c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.608609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf032903-8b5b-4501-b71e-d2d253038b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.608889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf032903-8b5b-4501-b71e-d2d253038b5c None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.609648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf032903-8b5b-4501-b71e-d2d253038b5c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:56.609995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf032903-8b5b-4501-b71e-d2d253038b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.611379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf032903-8b5b-4501-b71e-d2d253038b5c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:56.618924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 457/920] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:24:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:56.625947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf032903-8b5b-4501-b71e-d2d253038b5c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:56.658909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05809d3c-b413-4a47-95c6-7733617f279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.659773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05809d3c-b413-4a47-95c6-7733617f279d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.660057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05809d3c-b413-4a47-95c6-7733617f279d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.660645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05809d3c-b413-4a47-95c6-7733617f279d None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.661434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05809d3c-b413-4a47-95c6-7733617f279d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:56.661777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05809d3c-b413-4a47-95c6-7733617f279d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.663206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05809d3c-b413-4a47-95c6-7733617f279d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:56.676110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 464/921] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:24:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:56.682491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05809d3c-b413-4a47-95c6-7733617f279d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:56.738470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf032903-8b5b-4501-b71e-d2d253038b5c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.762125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:56.773868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2519f-0d01-4340-a86e-827b0b19e379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.774745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2519f-0d01-4340-a86e-827b0b19e379 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.775043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2519f-0d01-4340-a86e-827b0b19e379 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.775331 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2519f-0d01-4340-a86e-827b0b19e379 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.776113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2519f-0d01-4340-a86e-827b0b19e379 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:56.776434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2519f-0d01-4340-a86e-827b0b19e379 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.777935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2519f-0d01-4340-a86e-827b0b19e379 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:56.783695 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 458/922] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:24:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:56.789250 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2519f-0d01-4340-a86e-827b0b19e379 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:56.815696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05809d3c-b413-4a47-95c6-7733617f279d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.819021 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:56.851923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914198d1-2960-45f6-ba49-1b289f5b63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.852640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914198d1-2960-45f6-ba49-1b289f5b63d9 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.852933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914198d1-2960-45f6-ba49-1b289f5b63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.853296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914198d1-2960-45f6-ba49-1b289f5b63d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.854101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914198d1-2960-45f6-ba49-1b289f5b63d9 None admin] RBAC: Adding query filter params (role.id=566c06b24ff94e66bd6c851381e21e88, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=2393ed59b5e74a99ae55f15bdc2b5519) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:56.854420 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914198d1-2960-45f6-ba49-1b289f5b63d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.856188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914198d1-2960-45f6-ba49-1b289f5b63d9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:56.862977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 465/923] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:24:56 2022] GET /identity/v3/role_assignments?user.id=2393ed59b5e74a99ae55f15bdc2b5519&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=566c06b24ff94e66bd6c851381e21e88 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:56.920939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2519f-0d01-4340-a86e-827b0b19e379 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:56.960453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d59db1-dd30-4a83-a1b3-f201323cb73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:56.961438 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d59db1-dd30-4a83-a1b3-f201323cb73a None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.961899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d59db1-dd30-4a83-a1b3-f201323cb73a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.962327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d59db1-dd30-4a83-a1b3-f201323cb73a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.963243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d59db1-dd30-4a83-a1b3-f201323cb73a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:56.964930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d59db1-dd30-4a83-a1b3-f201323cb73a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:57.044368 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 459/924] 10.222.0.41 () {60 vars in 1144 bytes} [Thu May 26 12:24:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:24:58.207960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e352c4-d3d3-447e-9034-e3e39ecd4fa0 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.208968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e352c4-d3d3-447e-9034-e3e39ecd4fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.209508 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e352c4-d3d3-447e-9034-e3e39ecd4fa0 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.211345 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 466/925] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:58.217062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59061-3e55-4431-9bca-64bfd2344634 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.218078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59061-3e55-4431-9bca-64bfd2344634 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.218562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59061-3e55-4431-9bca-64bfd2344634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.236124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a1e59061-3e55-4431-9bca-64bfd2344634 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:58.237638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a1e59061-3e55-4431-9bca-64bfd2344634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:58.272981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.314963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 460/926] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:58.339757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e352c4-d3d3-447e-9034-e3e39ecd4fa0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.450049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e352c4-d3d3-447e-9034-e3e39ecd4fa0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.485972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.486696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.486985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.487265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.487978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.489411 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.490806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: WARNING keystone.server.flask.common [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 12:24:58.540032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.sql.core [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:24:58.540032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 12:24:58.540032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [parameters: {'id': '6b19e4a7ad104f41bdd75c657c431ef4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 12:24:58.540032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80394) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b19e4a7ad104f41bdd75c657c431ef4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b19e4a7ad104f41bdd75c657c431ef4. May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application conn.query(q) May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:24:58.557222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result.read() May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 12:24:58.558165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application next(self.gen) May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application yield resource May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application next(self.gen) May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise self.value May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application session.commit() May 26 12:24:58.559095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.session.flush() May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application compat.raise_( May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:24:58.559961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:24:58.560922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application conn.query(q) May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result.read() May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:24:58.561726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [parameters: {'id': '6b19e4a7ad104f41bdd75c657c431ef4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:58.563360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:58.564283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:58.564283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 12:24:58.564283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 12:24:58.564283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:58.564283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:58.564283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 12:24:58.564283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 12:24:58.564283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6b19e4a7ad104f41bdd75c657c431ef4. May 26 12:24:58.564283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:58.564283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 467/927] 10.222.0.41 () {60 vars in 1140 bytes} [Thu May 26 12:24:58 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:58.566268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59061-3e55-4431-9bca-64bfd2344634 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.674321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59061-3e55-4431-9bca-64bfd2344634 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.711336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56005069-6593-4bb8-af89-c6e95e015620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.712322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56005069-6593-4bb8-af89-c6e95e015620 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.712498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56005069-6593-4bb8-af89-c6e95e015620 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.712678 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56005069-6593-4bb8-af89-c6e95e015620 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.720429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56005069-6593-4bb8-af89-c6e95e015620 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.721913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56005069-6593-4bb8-af89-c6e95e015620 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-56005069-6593-4bb8-af89-c6e95e015620 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:24:58.736227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:58.742073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:58.744196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:24:58.744196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:24:58.744196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:24:58.744196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:24:58.744196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:24:58.744196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:24:58.744196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:24:58.744196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:58.744196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 461/928] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:58.745436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.773856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.803172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d20c8-aac5-4543-9024-deb148648af1 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.803489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d20c8-aac5-4543-9024-deb148648af1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.805193 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d20c8-aac5-4543-9024-deb148648af1 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.805942 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 462/929] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:58.816694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9f92-3ad1-43ff-a7d8-8dd4e5f92350 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.817125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9f92-3ad1-43ff-a7d8-8dd4e5f92350 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.817646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c9f92-3ad1-43ff-a7d8-8dd4e5f92350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.839719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6e2c9f92-3ad1-43ff-a7d8-8dd4e5f92350 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:58.841075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6e2c9f92-3ad1-43ff-a7d8-8dd4e5f92350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:58.866494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ac5ff-2551-49d3-9de1-7a47f24b1e6f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.871759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.914003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52392901-02bf-4afc-b9b5-241dca28cbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.915141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52392901-02bf-4afc-b9b5-241dca28cbdf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.916030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52392901-02bf-4afc-b9b5-241dca28cbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.916472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52392901-02bf-4afc-b9b5-241dca28cbdf None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.917421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52392901-02bf-4afc-b9b5-241dca28cbdf None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:58.917932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52392901-02bf-4afc-b9b5-241dca28cbdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.920592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52392901-02bf-4afc-b9b5-241dca28cbdf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.937786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 463/930] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:24:58.957963 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 468/931] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:58.959590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c9f92-3ad1-43ff-a7d8-8dd4e5f92350 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.083387 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c9f92-3ad1-43ff-a7d8-8dd4e5f92350 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.091360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5329b2-4b6a-4f4a-ad6f-a23cdc621c0f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.091883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5329b2-4b6a-4f4a-ad6f-a23cdc621c0f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.092373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5329b2-4b6a-4f4a-ad6f-a23cdc621c0f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.094280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 469/932] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:59.100137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0517-5bc9-469b-a0bf-ce469c598c6d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.100684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0517-5bc9-469b-a0bf-ce469c598c6d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.101126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0517-5bc9-469b-a0bf-ce469c598c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.125048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1f6e0517-5bc9-469b-a0bf-ce469c598c6d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:59.126696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b5aee-59fa-4a34-a13f-63c71e13540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.127538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1f6e0517-5bc9-469b-a0bf-ce469c598c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:59.127789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5aee-59fa-4a34-a13f-63c71e13540b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.128172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5aee-59fa-4a34-a13f-63c71e13540b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.128550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b5aee-59fa-4a34-a13f-63c71e13540b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.129340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b5aee-59fa-4a34-a13f-63c71e13540b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.131084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4b5aee-59fa-4a34-a13f-63c71e13540b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-ea4b5aee-59fa-4a34-a13f-63c71e13540b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:59.145145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:59.146453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:24:59.147439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:24:59.148488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 464/933] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:59.154121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b5aee-59fa-4a34-a13f-63c71e13540b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.184284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.220594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 470/934] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:24:59.244043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0517-5bc9-469b-a0bf-ce469c598c6d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.261297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.284049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b5aee-59fa-4a34-a13f-63c71e13540b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.325865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ac23b-d026-4433-aaa3-6c40b62439d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.326573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ac23b-d026-4433-aaa3-6c40b62439d7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.326865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ac23b-d026-4433-aaa3-6c40b62439d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.327141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ac23b-d026-4433-aaa3-6c40b62439d7 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.327854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ac23b-d026-4433-aaa3-6c40b62439d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:59.328164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ac23b-d026-4433-aaa3-6c40b62439d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.329536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ac23b-d026-4433-aaa3-6c40b62439d7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.334536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 465/935] 10.222.0.41 () {56 vars in 1122 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:59.335822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed6913-979b-4dea-ba57-6ae812725098 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.336065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed6913-979b-4dea-ba57-6ae812725098 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.336343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed6913-979b-4dea-ba57-6ae812725098 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.337800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 466/936] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:24:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:59.343474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a278602-e5dd-4752-aa3e-4b0fa97b4883 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.343757 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a278602-e5dd-4752-aa3e-4b0fa97b4883 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.344022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a278602-e5dd-4752-aa3e-4b0fa97b4883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.357361 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0517-5bc9-469b-a0bf-ce469c598c6d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.360956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6a278602-e5dd-4752-aa3e-4b0fa97b4883 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:59.362164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6a278602-e5dd-4752-aa3e-4b0fa97b4883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:59.392626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e46c4-16fc-4059-9b7a-d0aa915cd522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.393440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e46c4-16fc-4059-9b7a-d0aa915cd522 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.393759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e46c4-16fc-4059-9b7a-d0aa915cd522 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.394022 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e46c4-16fc-4059-9b7a-d0aa915cd522 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.405493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e46c4-16fc-4059-9b7a-d0aa915cd522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e40e46c4-16fc-4059-9b7a-d0aa915cd522 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:59.413836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:59.414754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:59.415597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 471/937] 10.222.0.41 () {56 vars in 1120 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:59.416854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e46c4-16fc-4059-9b7a-d0aa915cd522 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.438536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 467/938] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:24:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:24:59.439694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a278602-e5dd-4752-aa3e-4b0fa97b4883 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.469937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.496600 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.523705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e46c4-16fc-4059-9b7a-d0aa915cd522 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.560604 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0234a-8b4d-4ad0-869d-39fd4f23542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.561847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0234a-8b4d-4ad0-869d-39fd4f23542e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.562210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0234a-8b4d-4ad0-869d-39fd4f23542e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.562480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0234a-8b4d-4ad0-869d-39fd4f23542e None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.563116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0234a-8b4d-4ad0-869d-39fd4f23542e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:59.563426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0234a-8b4d-4ad0-869d-39fd4f23542e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.564276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a278602-e5dd-4752-aa3e-4b0fa97b4883 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.564889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0234a-8b4d-4ad0-869d-39fd4f23542e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.574721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 472/939] 10.222.0.41 () {56 vars in 1122 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.574721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0234a-8b4d-4ad0-869d-39fd4f23542e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.603585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db94ded-c48f-40a0-b01d-82b3e4cae79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.604253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db94ded-c48f-40a0-b01d-82b3e4cae79f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.604547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db94ded-c48f-40a0-b01d-82b3e4cae79f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.604814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db94ded-c48f-40a0-b01d-82b3e4cae79f None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.605556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db94ded-c48f-40a0-b01d-82b3e4cae79f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:59.605918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db94ded-c48f-40a0-b01d-82b3e4cae79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.607296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db94ded-c48f-40a0-b01d-82b3e4cae79f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.616541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 468/940] 10.222.0.41 () {56 vars in 1115 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.617268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db94ded-c48f-40a0-b01d-82b3e4cae79f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.688967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0234a-8b4d-4ad0-869d-39fd4f23542e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.700281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.723498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db94ded-c48f-40a0-b01d-82b3e4cae79f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.724427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf765db2-6b0e-4bdf-80b3-5e411396816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.725223 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf765db2-6b0e-4bdf-80b3-5e411396816a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.725509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf765db2-6b0e-4bdf-80b3-5e411396816a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.725823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf765db2-6b0e-4bdf-80b3-5e411396816a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.726475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf765db2-6b0e-4bdf-80b3-5e411396816a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.727940 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf765db2-6b0e-4bdf-80b3-5e411396816a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-cf765db2-6b0e-4bdf-80b3-5e411396816a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:59.739642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:59.740597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:59.741397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 473/941] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:59.742238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf765db2-6b0e-4bdf-80b3-5e411396816a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.744936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.766163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192edb9-64ac-492d-a2ca-8f898763c3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.766852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192edb9-64ac-492d-a2ca-8f898763c3bd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.767559 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192edb9-64ac-492d-a2ca-8f898763c3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.767850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192edb9-64ac-492d-a2ca-8f898763c3bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.768982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192edb9-64ac-492d-a2ca-8f898763c3bd None admin] RBAC: Adding query filter params (interface=public, service_id=e29f02ab93f64a268863e8f3ac249c8a, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:59.769305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192edb9-64ac-492d-a2ca-8f898763c3bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.771474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192edb9-64ac-492d-a2ca-8f898763c3bd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.783503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 469/942] 10.222.0.41 () {56 vars in 1251 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/endpoints?service_id=e29f02ab93f64a268863e8f3ac249c8a&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.783503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192edb9-64ac-492d-a2ca-8f898763c3bd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.850713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf765db2-6b0e-4bdf-80b3-5e411396816a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.886299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192edb9-64ac-492d-a2ca-8f898763c3bd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.887187 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dc30e-ea21-48a6-9b8d-1f1b8d71e7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.888447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dc30e-ea21-48a6-9b8d-1f1b8d71e7ac None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.888920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dc30e-ea21-48a6-9b8d-1f1b8d71e7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.889331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dc30e-ea21-48a6-9b8d-1f1b8d71e7ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.901097 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dc30e-ea21-48a6-9b8d-1f1b8d71e7ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.902701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dc30e-ea21-48a6-9b8d-1f1b8d71e7ac None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.919557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9824478-695a-4b0e-96e6-4332f9f5ba8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.920753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9824478-695a-4b0e-96e6-4332f9f5ba8c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.921046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9824478-695a-4b0e-96e6-4332f9f5ba8c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.921325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9824478-695a-4b0e-96e6-4332f9f5ba8c None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.922059 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9824478-695a-4b0e-96e6-4332f9f5ba8c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-177dc30e-ea21-48a6-9b8d-1f1b8d71e7ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:59.922170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:59.922982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:59.924502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:59.924502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:59.924502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:59.924502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:24:59.924732 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9824478-695a-4b0e-96e6-4332f9f5ba8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.924802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 474/943] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:59.924802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dc30e-ea21-48a6-9b8d-1f1b8d71e7ac None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.926199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9824478-695a-4b0e-96e6-4332f9f5ba8c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.937979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 470/944] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.938797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9824478-695a-4b0e-96e6-4332f9f5ba8c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.942445 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.986776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.033441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dc30e-ea21-48a6-9b8d-1f1b8d71e7ac None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.045114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9824478-695a-4b0e-96e6-4332f9f5ba8c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.078889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c3ed7-8568-41cf-9bb9-2cb9cc9d802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.079594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c3ed7-8568-41cf-9bb9-2cb9cc9d802d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.079861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c3ed7-8568-41cf-9bb9-2cb9cc9d802d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.080138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c3ed7-8568-41cf-9bb9-2cb9cc9d802d None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.080825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c3ed7-8568-41cf-9bb9-2cb9cc9d802d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.082229 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c3ed7-8568-41cf-9bb9-2cb9cc9d802d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.083207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbf86d-f901-4e61-9c85-21ed75164b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.083877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbf86d-f901-4e61-9c85-21ed75164b80 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.084168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbf86d-f901-4e61-9c85-21ed75164b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.084475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbf86d-f901-4e61-9c85-21ed75164b80 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.085185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbf86d-f901-4e61-9c85-21ed75164b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.085498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbf86d-f901-4e61-9c85-21ed75164b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.086889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbf86d-f901-4e61-9c85-21ed75164b80 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.090004 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 475/945] 10.222.0.41 () {56 vars in 1087 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:25:00.091020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c3ed7-8568-41cf-9bb9-2cb9cc9d802d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.104311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 471/946] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.112898 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbf86d-f901-4e61-9c85-21ed75164b80 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.291650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.304705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c3ed7-8568-41cf-9bb9-2cb9cc9d802d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.339742 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.370074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab2c05-37d4-4c8f-a486-0b39048960be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.370995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab2c05-37d4-4c8f-a486-0b39048960be None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.371429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab2c05-37d4-4c8f-a486-0b39048960be None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.371878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab2c05-37d4-4c8f-a486-0b39048960be None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.372729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab2c05-37d4-4c8f-a486-0b39048960be None admin] RBAC: Adding query filter params (type=compute) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.373184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab2c05-37d4-4c8f-a486-0b39048960be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.376750 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab2c05-37d4-4c8f-a486-0b39048960be None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.390158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 476/947] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.398962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbf86d-f901-4e61-9c85-21ed75164b80 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.453769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba380f-8bc5-4135-8f8a-abe4502b7f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.453769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba380f-8bc5-4135-8f8a-abe4502b7f5b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.453769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba380f-8bc5-4135-8f8a-abe4502b7f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.453769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ba380f-8bc5-4135-8f8a-abe4502b7f5b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.469225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba380f-8bc5-4135-8f8a-abe4502b7f5b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.470842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ba380f-8bc5-4135-8f8a-abe4502b7f5b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-66ba380f-8bc5-4135-8f8a-abe4502b7f5b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:00.505164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:00.506231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:00.507136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:00.507136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:00.507136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:00.507136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:00.507136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:00.507136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:00.507136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:00.507136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:00.507136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:00.507136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:00.508750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 472/948] 10.222.0.41 () {56 vars in 1117 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:00.513196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab2c05-37d4-4c8f-a486-0b39048960be None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.753204 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab2c05-37d4-4c8f-a486-0b39048960be None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.814122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc14cd-621b-4f5a-8e7c-16a8616d4f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.815167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc14cd-621b-4f5a-8e7c-16a8616d4f6a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.815703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc14cd-621b-4f5a-8e7c-16a8616d4f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.816249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc14cd-621b-4f5a-8e7c-16a8616d4f6a None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.817336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc14cd-621b-4f5a-8e7c-16a8616d4f6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.817870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc14cd-621b-4f5a-8e7c-16a8616d4f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.819569 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc14cd-621b-4f5a-8e7c-16a8616d4f6a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.839935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 477/949] 10.222.0.41 () {56 vars in 1149 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.848181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba380f-8bc5-4135-8f8a-abe4502b7f5b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.951786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ba380f-8bc5-4135-8f8a-abe4502b7f5b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.977016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.987972 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e948c7-6396-4e83-ab25-8fc5dd4e3f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.988710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e948c7-6396-4e83-ab25-8fc5dd4e3f97 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.005266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e948c7-6396-4e83-ab25-8fc5dd4e3f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.005266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e948c7-6396-4e83-ab25-8fc5dd4e3f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.005266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e948c7-6396-4e83-ab25-8fc5dd4e3f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.005266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e948c7-6396-4e83-ab25-8fc5dd4e3f97 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-04e948c7-6396-4e83-ab25-8fc5dd4e3f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:01.020371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:01.021259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:01.022313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:01.022313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:01.022313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:01.022313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:01.022313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 473/950] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:01.031012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc14cd-621b-4f5a-8e7c-16a8616d4f6a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.082550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.145487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc14cd-621b-4f5a-8e7c-16a8616d4f6a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.182409 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299274d-d386-436d-9bf6-48e543d7038b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.183438 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299274d-d386-436d-9bf6-48e543d7038b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.183929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299274d-d386-436d-9bf6-48e543d7038b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.184431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299274d-d386-436d-9bf6-48e543d7038b None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.185360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299274d-d386-436d-9bf6-48e543d7038b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:01.185945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299274d-d386-436d-9bf6-48e543d7038b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.187505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299274d-d386-436d-9bf6-48e543d7038b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.199734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 478/951] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:01.208562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e948c7-6396-4e83-ab25-8fc5dd4e3f97 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.327993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e948c7-6396-4e83-ab25-8fc5dd4e3f97 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.364002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842d4b2-0596-49cf-95d4-85ab3ebe633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.365152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842d4b2-0596-49cf-95d4-85ab3ebe633e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.365637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842d4b2-0596-49cf-95d4-85ab3ebe633e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.366162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842d4b2-0596-49cf-95d4-85ab3ebe633e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.373468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842d4b2-0596-49cf-95d4-85ab3ebe633e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.375234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842d4b2-0596-49cf-95d4-85ab3ebe633e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-8842d4b2-0596-49cf-95d4-85ab3ebe633e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:01.389770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:01.390755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:01.391717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:01.391717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:01.391717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:01.391717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:01.391717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:01.391717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:01.391717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:01.391717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:01.394259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 474/952] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:01.402758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299274d-d386-436d-9bf6-48e543d7038b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.461720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ce3cb-0b20-41ed-adff-5e3746273b8f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.462063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ce3cb-0b20-41ed-adff-5e3746273b8f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.462294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ce3cb-0b20-41ed-adff-5e3746273b8f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.463907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 475/953] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:01.468997 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5bed7-9990-4049-bc24-86fc30ae4ddf None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.469306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5bed7-9990-4049-bc24-86fc30ae4ddf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.469590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5bed7-9990-4049-bc24-86fc30ae4ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.487093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b6e5bed7-9990-4049-bc24-86fc30ae4ddf None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:01.488509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b6e5bed7-9990-4049-bc24-86fc30ae4ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:01.520381 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.523386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.524363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299274d-d386-436d-9bf6-48e543d7038b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.577688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f9950-8068-4008-9775-7af3dddaa51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.577688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f9950-8068-4008-9775-7af3dddaa51a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.577688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f9950-8068-4008-9775-7af3dddaa51a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.577688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f9950-8068-4008-9775-7af3dddaa51a None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.578142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f9950-8068-4008-9775-7af3dddaa51a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:01.578142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f9950-8068-4008-9775-7af3dddaa51a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.578142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f9950-8068-4008-9775-7af3dddaa51a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.580100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 476/954] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) May 26 12:25:01.595060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 479/955] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:01.596316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5bed7-9990-4049-bc24-86fc30ae4ddf None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.603293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f9950-8068-4008-9775-7af3dddaa51a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.707926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5bed7-9990-4049-bc24-86fc30ae4ddf None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.732387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f9950-8068-4008-9775-7af3dddaa51a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.756280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2e9c3-792c-4194-b566-db77335e5ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.757220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2e9c3-792c-4194-b566-db77335e5ea3 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.757512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2e9c3-792c-4194-b566-db77335e5ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.757825 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2e9c3-792c-4194-b566-db77335e5ea3 None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/2393ed59b5e74a99ae55f15bdc2b5519/roles/566c06b24ff94e66bd6c851381e21e88` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.760852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2e9c3-792c-4194-b566-db77335e5ea3 None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=2393ed59b5e74a99ae55f15bdc2b5519, role_id=566c06b24ff94e66bd6c851381e21e88)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.762570 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2e9c3-792c-4194-b566-db77335e5ea3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.772528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d10e-a474-4b82-8502-37e60218316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.777627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d10e-a474-4b82-8502-37e60218316a None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.777627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d10e-a474-4b82-8502-37e60218316a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.777627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5d10e-a474-4b82-8502-37e60218316a None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.777627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5d10e-a474-4b82-8502-37e60218316a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.777627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5d10e-a474-4b82-8502-37e60218316a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.837237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.sql.core [None req-4ae5d10e-a474-4b82-8502-37e60218316a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:25:01.837237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 12:25:01.837237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [parameters: {'user_id': 'df1b2030f44f47f5be1f6efc79f1ebbd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 12:25:01.837237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80394) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-4ae5d10e-a474-4b82-8502-37e60218316a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application conn.query(q) May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result.read() May 26 12:25:01.845055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:25:01.852955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application next(self.gen) May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application yield resource May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application next(self.gen) May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise self.value May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application session.commit() May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:25:01.854038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.session.flush() May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application compat.raise_( May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:25:01.855057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:25:01.856006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application conn.query(q) May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application result.read() May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:25:01.856841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [parameters: {'user_id': 'df1b2030f44f47f5be1f6efc79f1ebbd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:01.859242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 12:25:01.861303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 12:25:01.864706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 12:25:01.864706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 12:25:01.864706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:25:01.864706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:25:01.864706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 12:25:01.864706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:01.864706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 480/956] 10.222.0.41 () {60 vars in 1131 bytes} [Thu May 26 12:25:01 2022] POST /identity/v3/users => generated 160 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:01.864706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d10e-a474-4b82-8502-37e60218316a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.886179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.894594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 477/957] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:25:01 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/2393ed59b5e74a99ae55f15bdc2b5519/roles/566c06b24ff94e66bd6c851381e21e88 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:01.984322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5d10e-a474-4b82-8502-37e60218316a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.022286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283619-55d5-41c5-ad2c-20fd85a23549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.023105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283619-55d5-41c5-ad2c-20fd85a23549 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.023392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283619-55d5-41c5-ad2c-20fd85a23549 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.023671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283619-55d5-41c5-ad2c-20fd85a23549 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.032525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283619-55d5-41c5-ad2c-20fd85a23549 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.034309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283619-55d5-41c5-ad2c-20fd85a23549 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-8b283619-55d5-41c5-ad2c-20fd85a23549 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:02.050336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:02.051343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:02.052347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:02.052347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:02.052347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:02.052347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:02.052347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:02.052347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:02.052347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:02.052347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:02.052347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:25:02.052347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:02.055814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 481/958] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:02.058206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2e9c3-792c-4194-b566-db77335e5ea3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.096261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.175394 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2e9c3-792c-4194-b566-db77335e5ea3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.210807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a92d6d5-9660-4e36-93d6-a191ce287e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.211480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92d6d5-9660-4e36-93d6-a191ce287e25 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.211767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92d6d5-9660-4e36-93d6-a191ce287e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.212047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92d6d5-9660-4e36-93d6-a191ce287e25 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.212853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92d6d5-9660-4e36-93d6-a191ce287e25 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:02.213161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92d6d5-9660-4e36-93d6-a191ce287e25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.214633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a92d6d5-9660-4e36-93d6-a191ce287e25 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.257812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 478/959] 10.222.0.41 () {56 vars in 1101 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:02.553053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9d72-8449-4988-99bd-6e58d09ac155 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.553557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9d72-8449-4988-99bd-6e58d09ac155 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.553744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9d72-8449-4988-99bd-6e58d09ac155 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.557920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 482/960] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:02.563065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7ef3-31b4-4032-bd7a-6cd3894cb55a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.563476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7ef3-31b4-4032-bd7a-6cd3894cb55a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.563641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a7ef3-31b4-4032-bd7a-6cd3894cb55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.580089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6f6a7ef3-31b4-4032-bd7a-6cd3894cb55a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:02.581261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6f6a7ef3-31b4-4032-bd7a-6cd3894cb55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:02.647824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 479/961] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:02.670320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a9d72-8449-4988-99bd-6e58d09ac155 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.756079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.774805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a9d72-8449-4988-99bd-6e58d09ac155 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.808908 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34a2a5-a671-426f-960b-820b141b6695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.809632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a2a5-a671-426f-960b-820b141b6695 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.809942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a2a5-a671-426f-960b-820b141b6695 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.810214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34a2a5-a671-426f-960b-820b141b6695 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.810921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34a2a5-a671-426f-960b-820b141b6695 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.812278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34a2a5-a671-426f-960b-820b141b6695 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-3b34a2a5-a671-426f-960b-820b141b6695 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:02.824382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:02.825433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:02.827199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:02.829733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 483/962] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:02.832146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a7ef3-31b4-4032-bd7a-6cd3894cb55a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.848385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.853726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde0cc-93c2-45f9-92cd-b70f71371916 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.854018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde0cc-93c2-45f9-92cd-b70f71371916 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.854296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde0cc-93c2-45f9-92cd-b70f71371916 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.855784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 484/963] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:02.860440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc8544-eb5c-4b65-91d8-427f3a14a604 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.860736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc8544-eb5c-4b65-91d8-427f3a14a604 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.861017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc8544-eb5c-4b65-91d8-427f3a14a604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.877715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0bdc8544-eb5c-4b65-91d8-427f3a14a604 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:02.879427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0bdc8544-eb5c-4b65-91d8-427f3a14a604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:02.936104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a7ef3-31b4-4032-bd7a-6cd3894cb55a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.949699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 485/964] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:02.969404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc8544-eb5c-4b65-91d8-427f3a14a604 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.972887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46afeb4-ce69-4bda-9479-0ad58e288d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.973561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46afeb4-ce69-4bda-9479-0ad58e288d94 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.973882 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46afeb4-ce69-4bda-9479-0ad58e288d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.974160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46afeb4-ce69-4bda-9479-0ad58e288d94 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.974865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46afeb4-ce69-4bda-9479-0ad58e288d94 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:02.975174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46afeb4-ce69-4bda-9479-0ad58e288d94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.976535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46afeb4-ce69-4bda-9479-0ad58e288d94 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.986371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 480/965] 10.222.0.41 () {56 vars in 1122 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:02.987566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46afeb4-ce69-4bda-9479-0ad58e288d94 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.049406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:03.071941 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc8544-eb5c-4b65-91d8-427f3a14a604 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.080323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:03.099264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46afeb4-ce69-4bda-9479-0ad58e288d94 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.114839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d4dea-ee53-463c-b290-17fbbca38c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.115521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d4dea-ee53-463c-b290-17fbbca38c01 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.115806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d4dea-ee53-463c-b290-17fbbca38c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.116087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d4dea-ee53-463c-b290-17fbbca38c01 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.116993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d4dea-ee53-463c-b290-17fbbca38c01 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.118440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d4dea-ee53-463c-b290-17fbbca38c01 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.136591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f130ef6-f5f9-46a8-b3fe-c682252507b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.137265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f130ef6-f5f9-46a8-b3fe-c682252507b5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.137780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f130ef6-f5f9-46a8-b3fe-c682252507b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.138052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f130ef6-f5f9-46a8-b3fe-c682252507b5 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.138554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f130ef6-f5f9-46a8-b3fe-c682252507b5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:03.138867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f130ef6-f5f9-46a8-b3fe-c682252507b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.140901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f130ef6-f5f9-46a8-b3fe-c682252507b5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.145713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 481/966] 10.222.0.41 () {56 vars in 1122 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:03.151291 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f130ef6-f5f9-46a8-b3fe-c682252507b5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.194206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 486/967] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:25:02 2022] POST /identity/v3/services => generated 242 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:25:03.263594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f130ef6-f5f9-46a8-b3fe-c682252507b5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.308671 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def1d83e-0da6-4c32-a138-9396186b5f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.309351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1d83e-0da6-4c32-a138-9396186b5f34 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.309637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1d83e-0da6-4c32-a138-9396186b5f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.309948 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def1d83e-0da6-4c32-a138-9396186b5f34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.310695 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1d83e-0da6-4c32-a138-9396186b5f34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.312623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def1d83e-0da6-4c32-a138-9396186b5f34 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.320748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:03.381455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 482/968] 10.222.0.41 () {60 vars in 1144 bytes} [Thu May 26 12:25:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:25:04.231624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1e883-723a-4944-ad0d-371bb357e883 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.232280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1e883-723a-4944-ad0d-371bb357e883 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.232280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1e883-723a-4944-ad0d-371bb357e883 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.234263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 487/969] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:04.239332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b4dd2-2a0d-431e-8ee2-788a6c768858 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.239772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b4dd2-2a0d-431e-8ee2-788a6c768858 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.239918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b4dd2-2a0d-431e-8ee2-788a6c768858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.258316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-807b4dd2-2a0d-431e-8ee2-788a6c768858 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:04.259497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-807b4dd2-2a0d-431e-8ee2-788a6c768858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:04.332155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 483/970] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:04.354592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1e883-723a-4944-ad0d-371bb357e883 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:04.461031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1e883-723a-4944-ad0d-371bb357e883 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:04.494755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063c3ef-87d3-4ace-b1c9-5f422ae49cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:04.495566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063c3ef-87d3-4ace-b1c9-5f422ae49cee None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.495851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063c3ef-87d3-4ace-b1c9-5f422ae49cee None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.496126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063c3ef-87d3-4ace-b1c9-5f422ae49cee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.499331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:04.508108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063c3ef-87d3-4ace-b1c9-5f422ae49cee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c063c3ef-87d3-4ace-b1c9-5f422ae49cee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:04.516617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:04.517608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:04.518804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:04.521998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 488/971] 10.222.0.41 () {56 vars in 1120 bytes} [Thu May 26 12:25:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:04.523944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b4dd2-2a0d-431e-8ee2-788a6c768858 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:04.622472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b4dd2-2a0d-431e-8ee2-788a6c768858 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:04.642382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:04.656712 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcad4c-4863-4bdb-88bd-29f49f94bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:04.657372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcad4c-4863-4bdb-88bd-29f49f94bc57 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.657658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcad4c-4863-4bdb-88bd-29f49f94bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.657961 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcad4c-4863-4bdb-88bd-29f49f94bc57 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.658769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcad4c-4863-4bdb-88bd-29f49f94bc57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:04.659056 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcad4c-4863-4bdb-88bd-29f49f94bc57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:04.660415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcad4c-4863-4bdb-88bd-29f49f94bc57 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:04.673344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 484/972] 10.222.0.41 () {56 vars in 1115 bytes} [Thu May 26 12:25:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:04.674524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063c3ef-87d3-4ace-b1c9-5f422ae49cee None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:04.774366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063c3ef-87d3-4ace-b1c9-5f422ae49cee None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:04.806741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eee2b4-665a-4df7-9418-30aea3697425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:04.807529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eee2b4-665a-4df7-9418-30aea3697425 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.807813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eee2b4-665a-4df7-9418-30aea3697425 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.808090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eee2b4-665a-4df7-9418-30aea3697425 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.818991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eee2b4-665a-4df7-9418-30aea3697425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:04.820428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eee2b4-665a-4df7-9418-30aea3697425 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a8eee2b4-665a-4df7-9418-30aea3697425 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:04.837900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:04.838799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:04.844602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:04.844602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:04.844602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:04.844602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:04.844602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 489/973] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:04.844879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcad4c-4863-4bdb-88bd-29f49f94bc57 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:04.943770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcad4c-4863-4bdb-88bd-29f49f94bc57 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:04.977278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfe741-df7f-4899-be71-ecce093abdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:04.977969 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfe741-df7f-4899-be71-ecce093abdbb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.978259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfe741-df7f-4899-be71-ecce093abdbb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.978536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfe741-df7f-4899-be71-ecce093abdbb None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.979254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfe741-df7f-4899-be71-ecce093abdbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:04.979562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfe741-df7f-4899-be71-ecce093abdbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:04.980931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfe741-df7f-4899-be71-ecce093abdbb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:04.997737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 485/974] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:04.999065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eee2b4-665a-4df7-9418-30aea3697425 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.049472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.105337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eee2b4-665a-4df7-9418-30aea3697425 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.139670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0c50-f439-4c7a-876f-46e29f4f83cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.140484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0c50-f439-4c7a-876f-46e29f4f83cf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.140773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0c50-f439-4c7a-876f-46e29f4f83cf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.141053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0c50-f439-4c7a-876f-46e29f4f83cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.148843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad0c50-f439-4c7a-876f-46e29f4f83cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.150313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad0c50-f439-4c7a-876f-46e29f4f83cf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-faad0c50-f439-4c7a-876f-46e29f4f83cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:05.164791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:05.166007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:05.171912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 490/975] 10.222.0.41 () {56 vars in 1117 bytes} [Thu May 26 12:25:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:05.172536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfe741-df7f-4899-be71-ecce093abdbb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.215863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.282852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfe741-df7f-4899-be71-ecce093abdbb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.319562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b0d1f-f4a8-4ea3-ab7b-2804dd6826e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.320241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b0d1f-f4a8-4ea3-ab7b-2804dd6826e3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.320586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b0d1f-f4a8-4ea3-ab7b-2804dd6826e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.320863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b0d1f-f4a8-4ea3-ab7b-2804dd6826e3 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.321753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b0d1f-f4a8-4ea3-ab7b-2804dd6826e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:05.322070 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b0d1f-f4a8-4ea3-ab7b-2804dd6826e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.323514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b0d1f-f4a8-4ea3-ab7b-2804dd6826e3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.354090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 486/976] 10.222.0.41 () {56 vars in 1149 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:05.355346 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0c50-f439-4c7a-876f-46e29f4f83cf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.425262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e13c3-d150-4d42-a6c3-7c079cb44326 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.425603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e13c3-d150-4d42-a6c3-7c079cb44326 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.425870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283e13c3-d150-4d42-a6c3-7c079cb44326 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.429845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 487/977] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:05.432621 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445999ec-a487-4400-a8aa-3df5d9e92d6d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.433128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445999ec-a487-4400-a8aa-3df5d9e92d6d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.433418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445999ec-a487-4400-a8aa-3df5d9e92d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.451890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-445999ec-a487-4400-a8aa-3df5d9e92d6d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:05.453173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-445999ec-a487-4400-a8aa-3df5d9e92d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:05.475429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0c50-f439-4c7a-876f-46e29f4f83cf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.485358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.511438 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2cb6c9-ec4a-47e5-9e40-71b4182090fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.512143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cb6c9-ec4a-47e5-9e40-71b4182090fe None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.512436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cb6c9-ec4a-47e5-9e40-71b4182090fe None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.512707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2cb6c9-ec4a-47e5-9e40-71b4182090fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.525708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 488/978] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:05.546470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445999ec-a487-4400-a8aa-3df5d9e92d6d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.576516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.588573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cb6c9-ec4a-47e5-9e40-71b4182090fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.590054 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2cb6c9-ec4a-47e5-9e40-71b4182090fe None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.650074 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445999ec-a487-4400-a8aa-3df5d9e92d6d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.684508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a8b48-6472-4b8b-a0a3-c5d5216a1c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.685293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a8b48-6472-4b8b-a0a3-c5d5216a1c0b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.685581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a8b48-6472-4b8b-a0a3-c5d5216a1c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.686015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a8b48-6472-4b8b-a0a3-c5d5216a1c0b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.686668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a8b48-6472-4b8b-a0a3-c5d5216a1c0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.688031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a8b48-6472-4b8b-a0a3-c5d5216a1c0b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.706023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 491/979] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:05.706023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411b3e6-6864-4f71-82ca-4c6c4b2c1e30 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.706023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411b3e6-6864-4f71-82ca-4c6c4b2c1e30 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.706023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411b3e6-6864-4f71-82ca-4c6c4b2c1e30 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5f9a8b48-6472-4b8b-a0a3-c5d5216a1c0b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:05.706386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:05.707289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:05.708109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:05.708816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 492/980] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:05.708883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 489/981] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:05.708948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411b3e6-6864-4f71-82ca-4c6c4b2c1e30 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.709023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64b0b-1a1e-4318-bf77-2645722e7ba9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.709023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64b0b-1a1e-4318-bf77-2645722e7ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.709023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64b0b-1a1e-4318-bf77-2645722e7ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.716046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.723259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d0d64b0b-1a1e-4318-bf77-2645722e7ba9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:05.724455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d0d64b0b-1a1e-4318-bf77-2645722e7ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:05.789808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 490/982] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:05.790655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d64b0b-1a1e-4318-bf77-2645722e7ba9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.806632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411b3e6-6864-4f71-82ca-4c6c4b2c1e30 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.829181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.840845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f54e9-71e1-4f87-aa51-c76ff01a87ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.841893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f54e9-71e1-4f87-aa51-c76ff01a87ee None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.842182 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f54e9-71e1-4f87-aa51-c76ff01a87ee None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.842457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f54e9-71e1-4f87-aa51-c76ff01a87ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.852382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f54e9-71e1-4f87-aa51-c76ff01a87ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.853830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f54e9-71e1-4f87-aa51-c76ff01a87ee None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2a4f54e9-71e1-4f87-aa51-c76ff01a87ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:05.871471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:05.872603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:05.874548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:05.874548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:05.874548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:05.874548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:05.874548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 493/983] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:05.874548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f54e9-71e1-4f87-aa51-c76ff01a87ee None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.907332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d64b0b-1a1e-4318-bf77-2645722e7ba9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.931887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.941057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c6db5-1134-4995-b7df-820dcff33ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.943842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c6db5-1134-4995-b7df-820dcff33ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.943842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c6db5-1134-4995-b7df-820dcff33ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.943842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c6db5-1134-4995-b7df-820dcff33ac4 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.943842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c6db5-1134-4995-b7df-820dcff33ac4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:05.943842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c6db5-1134-4995-b7df-820dcff33ac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.944785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c6db5-1134-4995-b7df-820dcff33ac4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.949441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 491/984] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:05.950343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c6db5-1134-4995-b7df-820dcff33ac4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.974052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f54e9-71e1-4f87-aa51-c76ff01a87ee None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.007122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b4154-684c-4c61-a249-a45bef0f3f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.007917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b4154-684c-4c61-a249-a45bef0f3f26 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.008203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b4154-684c-4c61-a249-a45bef0f3f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.008479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b4154-684c-4c61-a249-a45bef0f3f26 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.009125 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b4154-684c-4c61-a249-a45bef0f3f26 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.010504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b4154-684c-4c61-a249-a45bef0f3f26 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-987b4154-684c-4c61-a249-a45bef0f3f26 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:06.023076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:06.024045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:06.024857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 494/985] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:06.025638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b4154-684c-4c61-a249-a45bef0f3f26 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.037411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.058210 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c6db5-1134-4995-b7df-820dcff33ac4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.086753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0649d7-8105-4104-8ad2-da2ae2052027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.087422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0649d7-8105-4104-8ad2-da2ae2052027 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.087707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0649d7-8105-4104-8ad2-da2ae2052027 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.087985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0649d7-8105-4104-8ad2-da2ae2052027 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.088699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0649d7-8105-4104-8ad2-da2ae2052027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.089006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0649d7-8105-4104-8ad2-da2ae2052027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.090403 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0649d7-8105-4104-8ad2-da2ae2052027 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.101499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 492/986] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.102476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0649d7-8105-4104-8ad2-da2ae2052027 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.128502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b4154-684c-4c61-a249-a45bef0f3f26 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.150921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.161653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34bb45-3c5b-477a-a656-1a4639deb1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.162337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34bb45-3c5b-477a-a656-1a4639deb1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.162626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34bb45-3c5b-477a-a656-1a4639deb1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.162937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34bb45-3c5b-477a-a656-1a4639deb1c1 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.167456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34bb45-3c5b-477a-a656-1a4639deb1c1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.167456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34bb45-3c5b-477a-a656-1a4639deb1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.167456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34bb45-3c5b-477a-a656-1a4639deb1c1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.170720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 495/987] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.171487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34bb45-3c5b-477a-a656-1a4639deb1c1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.201680 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0649d7-8105-4104-8ad2-da2ae2052027 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.234846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3710e9-736d-4d92-87e8-3ba32132e0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.235616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3710e9-736d-4d92-87e8-3ba32132e0fd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.236030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3710e9-736d-4d92-87e8-3ba32132e0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.236331 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3710e9-736d-4d92-87e8-3ba32132e0fd None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.237035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3710e9-736d-4d92-87e8-3ba32132e0fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.237348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3710e9-736d-4d92-87e8-3ba32132e0fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.238763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3710e9-736d-4d92-87e8-3ba32132e0fd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.243677 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 493/988] 10.222.0.41 () {56 vars in 1122 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.244553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3710e9-736d-4d92-87e8-3ba32132e0fd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.258827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.273021 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34bb45-3c5b-477a-a656-1a4639deb1c1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.307039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24847a61-4674-4086-b085-d9eaa346627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.307826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24847a61-4674-4086-b085-d9eaa346627f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.308116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24847a61-4674-4086-b085-d9eaa346627f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.308459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24847a61-4674-4086-b085-d9eaa346627f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.315111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24847a61-4674-4086-b085-d9eaa346627f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.316540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24847a61-4674-4086-b085-d9eaa346627f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-24847a61-4674-4086-b085-d9eaa346627f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:06.330866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:06.331808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:06.332667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:06.332667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:06.332667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:06.332667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:06.332667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:06.332667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:06.332667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:06.332667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:06.332667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 496/989] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:06.333142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24847a61-4674-4086-b085-d9eaa346627f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.348231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3710e9-736d-4d92-87e8-3ba32132e0fd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.380708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.382209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589b5a4-f275-462f-82b0-4e8c7e80f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.382864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589b5a4-f275-462f-82b0-4e8c7e80f43d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.383147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589b5a4-f275-462f-82b0-4e8c7e80f43d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.383423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589b5a4-f275-462f-82b0-4e8c7e80f43d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.384204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589b5a4-f275-462f-82b0-4e8c7e80f43d None admin] RBAC: Adding query filter params (interface=public, service_id=fc010243ed5647d19f6ce9e9e053e922, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.384522 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589b5a4-f275-462f-82b0-4e8c7e80f43d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.385902 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589b5a4-f275-462f-82b0-4e8c7e80f43d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.390838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 494/990] 10.222.0.41 () {56 vars in 1251 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/endpoints?service_id=fc010243ed5647d19f6ce9e9e053e922&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.391597 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589b5a4-f275-462f-82b0-4e8c7e80f43d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.432513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24847a61-4674-4086-b085-d9eaa346627f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.466118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760bb5d-de6d-471b-a039-a8ba6e1571fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.466775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bb5d-de6d-471b-a039-a8ba6e1571fc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.467572 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bb5d-de6d-471b-a039-a8ba6e1571fc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.467855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760bb5d-de6d-471b-a039-a8ba6e1571fc None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.468552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760bb5d-de6d-471b-a039-a8ba6e1571fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.468861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760bb5d-de6d-471b-a039-a8ba6e1571fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.469826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.470247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760bb5d-de6d-471b-a039-a8ba6e1571fc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.475217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 497/991] 10.222.0.41 () {56 vars in 1122 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.475850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760bb5d-de6d-471b-a039-a8ba6e1571fc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.498718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589b5a4-f275-462f-82b0-4e8c7e80f43d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.533205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71511e-ac55-4d2c-a102-48a644abb9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.533904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71511e-ac55-4d2c-a102-48a644abb9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.534196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71511e-ac55-4d2c-a102-48a644abb9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.534476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71511e-ac55-4d2c-a102-48a644abb9b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.535264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71511e-ac55-4d2c-a102-48a644abb9b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.535577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71511e-ac55-4d2c-a102-48a644abb9b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.537020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71511e-ac55-4d2c-a102-48a644abb9b4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.549469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 495/992] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.550292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71511e-ac55-4d2c-a102-48a644abb9b4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.580834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760bb5d-de6d-471b-a039-a8ba6e1571fc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.594321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.615224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41610e66-f0d4-472f-9989-9b9668457499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.615933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610e66-f0d4-472f-9989-9b9668457499 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.617821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610e66-f0d4-472f-9989-9b9668457499 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.617821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610e66-f0d4-472f-9989-9b9668457499 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.617821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41610e66-f0d4-472f-9989-9b9668457499 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.618538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41610e66-f0d4-472f-9989-9b9668457499 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.625435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 498/993] 10.222.0.41 () {56 vars in 1087 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:25:06.626253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41610e66-f0d4-472f-9989-9b9668457499 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.649440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71511e-ac55-4d2c-a102-48a644abb9b4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.690724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8cee8-852e-44a6-b949-399595627ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.691419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8cee8-852e-44a6-b949-399595627ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.691706 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8cee8-852e-44a6-b949-399595627ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.691988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb8cee8-852e-44a6-b949-399595627ea9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.692822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8cee8-852e-44a6-b949-399595627ea9 None admin] RBAC: Adding query filter params (interface=admin, service_id=e29f02ab93f64a268863e8f3ac249c8a, region_id=RegionOne) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.693230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8cee8-852e-44a6-b949-399595627ea9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.694614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb8cee8-852e-44a6-b949-399595627ea9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.697516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.706783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 496/994] 10.222.0.41 () {56 vars in 1249 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/endpoints?service_id=e29f02ab93f64a268863e8f3ac249c8a&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.709476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8cee8-852e-44a6-b949-399595627ea9 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.752259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41610e66-f0d4-472f-9989-9b9668457499 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.790832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039029a1-5608-4a2b-81a8-4252211c2735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.791500 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039029a1-5608-4a2b-81a8-4252211c2735 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.791782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039029a1-5608-4a2b-81a8-4252211c2735 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.792057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039029a1-5608-4a2b-81a8-4252211c2735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.792896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039029a1-5608-4a2b-81a8-4252211c2735 None admin] RBAC: Adding query filter params (role.id=566c06b24ff94e66bd6c851381e21e88, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=2393ed59b5e74a99ae55f15bdc2b5519) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.793207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039029a1-5608-4a2b-81a8-4252211c2735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.794691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039029a1-5608-4a2b-81a8-4252211c2735 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.801765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 499/995] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/role_assignments?user.id=2393ed59b5e74a99ae55f15bdc2b5519&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=566c06b24ff94e66bd6c851381e21e88 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.826557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb8cee8-852e-44a6-b949-399595627ea9 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.865320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4875724-8f56-473c-b278-aed722d07a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.866045 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4875724-8f56-473c-b278-aed722d07a50 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.866339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4875724-8f56-473c-b278-aed722d07a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.866624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4875724-8f56-473c-b278-aed722d07a50 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.867332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4875724-8f56-473c-b278-aed722d07a50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.868775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4875724-8f56-473c-b278-aed722d07a50 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.876340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 497/996] 10.222.0.41 () {56 vars in 1087 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:25:08.875188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf95b1-de81-4434-9334-b67c39320b2b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.875776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf95b1-de81-4434-9334-b67c39320b2b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.875776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf95b1-de81-4434-9334-b67c39320b2b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.877258 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 500/997] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:08.882477 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855cb33-6e58-43a5-b6ba-64184ba3aee1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.882948 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855cb33-6e58-43a5-b6ba-64184ba3aee1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.883026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855cb33-6e58-43a5-b6ba-64184ba3aee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.905586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b855cb33-6e58-43a5-b6ba-64184ba3aee1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:08.906863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b855cb33-6e58-43a5-b6ba-64184ba3aee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:08.969290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:08.977566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 498/998] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:09.001096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf95b1-de81-4434-9334-b67c39320b2b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.016529 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b20c-1ffe-4b5d-8743-25a14c913fdf None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.016821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b20c-1ffe-4b5d-8743-25a14c913fdf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.017096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b20c-1ffe-4b5d-8743-25a14c913fdf None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.018796 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 499/999] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:09.023551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dbf8c-751a-46ce-a068-ec5fda766aef None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.023839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dbf8c-751a-46ce-a068-ec5fda766aef None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.024121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8dbf8c-751a-46ce-a068-ec5fda766aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.041357 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-be8dbf8c-751a-46ce-a068-ec5fda766aef None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:09.042566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-be8dbf8c-751a-46ce-a068-ec5fda766aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:09.046014 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.112015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf95b1-de81-4434-9334-b67c39320b2b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.120333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 500/1000] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:09.121644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ddc2b-0ddf-41ff-826c-2f3849de905c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.121968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ddc2b-0ddf-41ff-826c-2f3849de905c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.122246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ddc2b-0ddf-41ff-826c-2f3849de905c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.123698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 501/1001] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:09.131079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9b93b-5e51-4e6f-9baf-43ee8ef5de83 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.131306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9b93b-5e51-4e6f-9baf-43ee8ef5de83 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.131582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9b93b-5e51-4e6f-9baf-43ee8ef5de83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.148068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8ca9b93b-5e51-4e6f-9baf-43ee8ef5de83 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:09.148245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6578f-0966-49d5-91da-19aee4e0ee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.149029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6578f-0966-49d5-91da-19aee4e0ee39 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.149242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8ca9b93b-5e51-4e6f-9baf-43ee8ef5de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:09.149355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6578f-0966-49d5-91da-19aee4e0ee39 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.149577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6578f-0966-49d5-91da-19aee4e0ee39 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.150249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6578f-0966-49d5-91da-19aee4e0ee39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.151605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6578f-0966-49d5-91da-19aee4e0ee39 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-25d6578f-0966-49d5-91da-19aee4e0ee39 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:09.163626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:09.164599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:09.165450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 501/1002] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:09.166261 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6578f-0966-49d5-91da-19aee4e0ee39 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.219526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 502/1003] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:09.220364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9b93b-5e51-4e6f-9baf-43ee8ef5de83 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.273448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.275760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6578f-0966-49d5-91da-19aee4e0ee39 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.278067 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.307739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692db2-64ae-4bef-a10c-350407ac82a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.308515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692db2-64ae-4bef-a10c-350407ac82a3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.308796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692db2-64ae-4bef-a10c-350407ac82a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.309481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7692db2-64ae-4bef-a10c-350407ac82a3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.310209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7692db2-64ae-4bef-a10c-350407ac82a3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.311587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7692db2-64ae-4bef-a10c-350407ac82a3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.317486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9b93b-5e51-4e6f-9baf-43ee8ef5de83 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b7692db2-64ae-4bef-a10c-350407ac82a3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:09.323556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:09.324692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:09.325563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 502/1004] 10.222.0.41 () {56 vars in 1105 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:09.326935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692db2-64ae-4bef-a10c-350407ac82a3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.359614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3331383-ab16-41b9-a8ad-a9bdc51d6085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.360280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3331383-ab16-41b9-a8ad-a9bdc51d6085 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.360568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3331383-ab16-41b9-a8ad-a9bdc51d6085 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.360847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3331383-ab16-41b9-a8ad-a9bdc51d6085 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.361562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3331383-ab16-41b9-a8ad-a9bdc51d6085 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.361893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3331383-ab16-41b9-a8ad-a9bdc51d6085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.363266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3331383-ab16-41b9-a8ad-a9bdc51d6085 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.368095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 503/1005] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.368787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3331383-ab16-41b9-a8ad-a9bdc51d6085 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.431895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7692db2-64ae-4bef-a10c-350407ac82a3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.469950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3331383-ab16-41b9-a8ad-a9bdc51d6085 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.472691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20b3b-4511-4f5a-9fda-8e2b97a95c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.473493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20b3b-4511-4f5a-9fda-8e2b97a95c23 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.473807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20b3b-4511-4f5a-9fda-8e2b97a95c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.474086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b20b3b-4511-4f5a-9fda-8e2b97a95c23 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.474730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b20b3b-4511-4f5a-9fda-8e2b97a95c23 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.476089 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b20b3b-4511-4f5a-9fda-8e2b97a95c23 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.486883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-35b20b3b-4511-4f5a-9fda-8e2b97a95c23 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:09.489139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:09.490434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:09.491428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 503/1006] 10.222.0.41 () {56 vars in 1126 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:09.492204 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20b3b-4511-4f5a-9fda-8e2b97a95c23 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.509181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cd524-a9f2-4bd4-bb2d-d07ca1b42630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.509899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cd524-a9f2-4bd4-bb2d-d07ca1b42630 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.510166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cd524-a9f2-4bd4-bb2d-d07ca1b42630 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.510443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cd524-a9f2-4bd4-bb2d-d07ca1b42630 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.511154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cd524-a9f2-4bd4-bb2d-d07ca1b42630 None admin] RBAC: Adding query filter params (name=image) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.511464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cd524-a9f2-4bd4-bb2d-d07ca1b42630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.512830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cd524-a9f2-4bd4-bb2d-d07ca1b42630 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.518376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 504/1007] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.519161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cd524-a9f2-4bd4-bb2d-d07ca1b42630 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.528091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.595787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b20b3b-4511-4f5a-9fda-8e2b97a95c23 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.614934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cd524-a9f2-4bd4-bb2d-d07ca1b42630 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.628883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac15d8c-d3de-49c2-aa52-cc2212652855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.629593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15d8c-d3de-49c2-aa52-cc2212652855 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.629918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15d8c-d3de-49c2-aa52-cc2212652855 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.630196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac15d8c-d3de-49c2-aa52-cc2212652855 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.630901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15d8c-d3de-49c2-aa52-cc2212652855 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.631241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15d8c-d3de-49c2-aa52-cc2212652855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.632600 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac15d8c-d3de-49c2-aa52-cc2212652855 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.637518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 504/1008] 10.222.0.41 () {56 vars in 1112 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.638162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac15d8c-d3de-49c2-aa52-cc2212652855 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.653126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f4189-1e3e-4da3-8c54-8cb85121c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.653816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f4189-1e3e-4da3-8c54-8cb85121c816 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.654102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f4189-1e3e-4da3-8c54-8cb85121c816 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.654447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f4189-1e3e-4da3-8c54-8cb85121c816 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.655156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f4189-1e3e-4da3-8c54-8cb85121c816 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.661095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f4189-1e3e-4da3-8c54-8cb85121c816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.661095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f4189-1e3e-4da3-8c54-8cb85121c816 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.661487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 505/1009] 10.222.0.41 () {56 vars in 1122 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.662275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f4189-1e3e-4da3-8c54-8cb85121c816 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.708744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.731854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.738080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac15d8c-d3de-49c2-aa52-cc2212652855 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.762067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f4189-1e3e-4da3-8c54-8cb85121c816 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.770407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c741b50-753b-463c-af94-5f1bd7d34086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.771070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c741b50-753b-463c-af94-5f1bd7d34086 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.771358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c741b50-753b-463c-af94-5f1bd7d34086 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.771640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c741b50-753b-463c-af94-5f1bd7d34086 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.772354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c741b50-753b-463c-af94-5f1bd7d34086 None admin] RBAC: Adding query filter params (type=image) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.772661 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c741b50-753b-463c-af94-5f1bd7d34086 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.774065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c741b50-753b-463c-af94-5f1bd7d34086 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.778592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 505/1010] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.779886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c741b50-753b-463c-af94-5f1bd7d34086 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.799557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a397b-9994-45ca-bcb9-2cdd86cfd816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.800239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a397b-9994-45ca-bcb9-2cdd86cfd816 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.800524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a397b-9994-45ca-bcb9-2cdd86cfd816 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.800803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a397b-9994-45ca-bcb9-2cdd86cfd816 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.801691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a397b-9994-45ca-bcb9-2cdd86cfd816 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.803128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a397b-9994-45ca-bcb9-2cdd86cfd816 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.894017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c741b50-753b-463c-af94-5f1bd7d34086 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.957700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 506/1011] 10.222.0.41 () {60 vars in 1144 bytes} [Thu May 26 12:25:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:09.970012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d66cf-1baa-4955-b075-1230aeeae42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.970799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d66cf-1baa-4955-b075-1230aeeae42d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.971628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d66cf-1baa-4955-b075-1230aeeae42d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.971628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d66cf-1baa-4955-b075-1230aeeae42d None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.972808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d66cf-1baa-4955-b075-1230aeeae42d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.972808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d66cf-1baa-4955-b075-1230aeeae42d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.974168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d66cf-1baa-4955-b075-1230aeeae42d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.980469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 506/1012] 10.222.0.41 () {56 vars in 1122 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.986730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a397b-9994-45ca-bcb9-2cdd86cfd816 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.108091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a397b-9994-45ca-bcb9-2cdd86cfd816 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.110266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.144679 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6015d4-158e-47ca-882c-0860dd9eeb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.145880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6015d4-158e-47ca-882c-0860dd9eeb8b None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.146169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6015d4-158e-47ca-882c-0860dd9eeb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.146459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6015d4-158e-47ca-882c-0860dd9eeb8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.147415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6015d4-158e-47ca-882c-0860dd9eeb8b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.149352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6015d4-158e-47ca-882c-0860dd9eeb8b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.238265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 507/1013] 10.222.0.41 () {60 vars in 1144 bytes} [Thu May 26 12:25:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:25:11.996711 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d461421-6d22-4588-b82a-e99e0e8c26b6 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.997231 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d461421-6d22-4588-b82a-e99e0e8c26b6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.997363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d461421-6d22-4588-b82a-e99e0e8c26b6 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.000289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 507/1014] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:12.004717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fd9fb-6525-4917-ab2e-4b6ea95c5805 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.005133 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fd9fb-6525-4917-ab2e-4b6ea95c5805 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.005298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4fd9fb-6525-4917-ab2e-4b6ea95c5805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.022340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5d4fd9fb-6525-4917-ab2e-4b6ea95c5805 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:12.023603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5d4fd9fb-6525-4917-ab2e-4b6ea95c5805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:12.108560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 508/1015] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:12 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:12.131153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d461421-6d22-4588-b82a-e99e0e8c26b6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.153581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.232151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d461421-6d22-4588-b82a-e99e0e8c26b6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.258009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362674e-d3fc-4505-a3af-bcba9c903416 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.258322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362674e-d3fc-4505-a3af-bcba9c903416 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.258498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362674e-d3fc-4505-a3af-bcba9c903416 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.261720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 509/1016] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:12.265707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748516d-dd69-4ab8-99e4-f68009c681a2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.265999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748516d-dd69-4ab8-99e4-f68009c681a2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.266277 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748516d-dd69-4ab8-99e4-f68009c681a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.271629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f74a5-a0f0-4b1d-a8e7-93ad9f09f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.272305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f74a5-a0f0-4b1d-a8e7-93ad9f09f846 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.272593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f74a5-a0f0-4b1d-a8e7-93ad9f09f846 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.272871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f74a5-a0f0-4b1d-a8e7-93ad9f09f846 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.273610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f74a5-a0f0-4b1d-a8e7-93ad9f09f846 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.275014 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f74a5-a0f0-4b1d-a8e7-93ad9f09f846 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.289334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d748516d-dd69-4ab8-99e4-f68009c681a2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:12.292170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d748516d-dd69-4ab8-99e4-f68009c681a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:12.356680 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 510/1017] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:12 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:12.358218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 508/1018] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:25:12 2022] POST /identity/v3/services => generated 242 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:12.381199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748516d-dd69-4ab8-99e4-f68009c681a2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.402637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.443316 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e0e78-a90c-47ab-ac5d-278bd8268125 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.443613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e0e78-a90c-47ab-ac5d-278bd8268125 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.443936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e0e78-a90c-47ab-ac5d-278bd8268125 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.445630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 509/1019] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:12.451267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955f60-1aa5-457c-bfcf-7d48212d8263 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.451608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955f60-1aa5-457c-bfcf-7d48212d8263 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.451898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8955f60-1aa5-457c-bfcf-7d48212d8263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.471529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b8955f60-1aa5-457c-bfcf-7d48212d8263 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:12.472764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b8955f60-1aa5-457c-bfcf-7d48212d8263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:12.497740 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748516d-dd69-4ab8-99e4-f68009c681a2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.547082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c894ec6-fcfb-4ccf-a303-909e7fe62451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.547827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c894ec6-fcfb-4ccf-a303-909e7fe62451 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.548116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c894ec6-fcfb-4ccf-a303-909e7fe62451 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.549217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c894ec6-fcfb-4ccf-a303-909e7fe62451 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.553080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 510/1020] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:12.559651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c894ec6-fcfb-4ccf-a303-909e7fe62451 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6c894ec6-fcfb-4ccf-a303-909e7fe62451 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:12.568009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:12.568917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:12.570246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 511/1021] 10.222.0.41 () {56 vars in 1120 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:12.575337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c894ec6-fcfb-4ccf-a303-909e7fe62451 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.575454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8955f60-1aa5-457c-bfcf-7d48212d8263 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.589229 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.659555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.683034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8955f60-1aa5-457c-bfcf-7d48212d8263 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.687871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c894ec6-fcfb-4ccf-a303-909e7fe62451 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.719847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b7136-818c-455d-ae8e-902ebe0dbc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.720635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7136-818c-455d-ae8e-902ebe0dbc93 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.720933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7136-818c-455d-ae8e-902ebe0dbc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.721216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7136-818c-455d-ae8e-902ebe0dbc93 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.721990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b7136-818c-455d-ae8e-902ebe0dbc93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:12.722307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b7136-818c-455d-ae8e-902ebe0dbc93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.723471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932e7a1-eccd-4701-9ae0-e1319129c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.723680 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b7136-818c-455d-ae8e-902ebe0dbc93 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.724263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932e7a1-eccd-4701-9ae0-e1319129c731 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.724551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932e7a1-eccd-4701-9ae0-e1319129c731 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.724825 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932e7a1-eccd-4701-9ae0-e1319129c731 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.726063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932e7a1-eccd-4701-9ae0-e1319129c731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.727573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0932e7a1-eccd-4701-9ae0-e1319129c731 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.729235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 512/1022] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:12.737984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 511/1023] 10.222.0.41 () {56 vars in 1115 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:12.738160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932e7a1-eccd-4701-9ae0-e1319129c731 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.738683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b7136-818c-455d-ae8e-902ebe0dbc93 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.817341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.841409 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932e7a1-eccd-4701-9ae0-e1319129c731 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.851566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b7136-818c-455d-ae8e-902ebe0dbc93 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.878426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c35810-104d-4b59-a0eb-f1f9e9f3cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.879344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c35810-104d-4b59-a0eb-f1f9e9f3cd62 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.879632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c35810-104d-4b59-a0eb-f1f9e9f3cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.879912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c35810-104d-4b59-a0eb-f1f9e9f3cd62 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.881212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c35810-104d-4b59-a0eb-f1f9e9f3cd62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.882130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c35810-104d-4b59-a0eb-f1f9e9f3cd62 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.891050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d486c-6257-487f-a782-25012e78646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.891899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d486c-6257-487f-a782-25012e78646f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.892187 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d486c-6257-487f-a782-25012e78646f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.892468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d486c-6257-487f-a782-25012e78646f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.897416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.903773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d486c-6257-487f-a782-25012e78646f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.906416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d486c-6257-487f-a782-25012e78646f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-778d486c-6257-487f-a782-25012e78646f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:12.922795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:12.923976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:12.924895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:12.924895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:12.924895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:12.924895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:12.925598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 512/1024] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:12.930449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d486c-6257-487f-a782-25012e78646f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:13.004556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 513/1025] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:25:12 2022] POST /identity/v3/projects => generated 311 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:13.031528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d486c-6257-487f-a782-25012e78646f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.057942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:13.075301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d25376-8fe5-4ff3-9eb8-18d88d9c0e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.075301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d25376-8fe5-4ff3-9eb8-18d88d9c0e3d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.075301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d25376-8fe5-4ff3-9eb8-18d88d9c0e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.075301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d25376-8fe5-4ff3-9eb8-18d88d9c0e3d None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.075769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d25376-8fe5-4ff3-9eb8-18d88d9c0e3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:13.075769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d25376-8fe5-4ff3-9eb8-18d88d9c0e3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.075769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d25376-8fe5-4ff3-9eb8-18d88d9c0e3d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.092900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 513/1026] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:13.098381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c35810-104d-4b59-a0eb-f1f9e9f3cd62 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:13.212325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c35810-104d-4b59-a0eb-f1f9e9f3cd62 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.248153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c908b5c-a578-45d7-abad-edf06df91866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.248948 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c908b5c-a578-45d7-abad-edf06df91866 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.249233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c908b5c-a578-45d7-abad-edf06df91866 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.249581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c908b5c-a578-45d7-abad-edf06df91866 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.258558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c908b5c-a578-45d7-abad-edf06df91866 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.260002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c908b5c-a578-45d7-abad-edf06df91866 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0c908b5c-a578-45d7-abad-edf06df91866 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:13.275052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:13.276164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:13.277212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 514/1027] 10.222.0.41 () {56 vars in 1093 bytes} [Thu May 26 12:25:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:13.282951 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d25376-8fe5-4ff3-9eb8-18d88d9c0e3d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:13.384758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d25376-8fe5-4ff3-9eb8-18d88d9c0e3d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.419159 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6d1aa-2878-4d53-8fdc-08d4af5ba059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.419863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6d1aa-2878-4d53-8fdc-08d4af5ba059 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.420153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6d1aa-2878-4d53-8fdc-08d4af5ba059 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.420436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6d1aa-2878-4d53-8fdc-08d4af5ba059 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.421271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6d1aa-2878-4d53-8fdc-08d4af5ba059 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:13.421583 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6d1aa-2878-4d53-8fdc-08d4af5ba059 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.423048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e6d1aa-2878-4d53-8fdc-08d4af5ba059 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.446931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 514/1028] 10.222.0.41 () {56 vars in 1133 bytes} [Thu May 26 12:25:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:13.447215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c908b5c-a578-45d7-abad-edf06df91866 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:13.504339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:13.547791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c908b5c-a578-45d7-abad-edf06df91866 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.585163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b6bf-1dec-4d17-a035-151d1fa2c412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.586095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b6bf-1dec-4d17-a035-151d1fa2c412 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.586533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b6bf-1dec-4d17-a035-151d1fa2c412 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.586983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17b6bf-1dec-4d17-a035-151d1fa2c412 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.658956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b6bf-1dec-4d17-a035-151d1fa2c412 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.660635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17b6bf-1dec-4d17-a035-151d1fa2c412 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.714564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:13.765896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 515/1029] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:13.767128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6d1aa-2878-4d53-8fdc-08d4af5ba059 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:13.811148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:13.868987 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6d1aa-2878-4d53-8fdc-08d4af5ba059 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:13.905010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8471266-1ac8-49ce-907f-4aae26ac103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:13.905833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471266-1ac8-49ce-907f-4aae26ac103f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:13.906120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471266-1ac8-49ce-907f-4aae26ac103f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:13.906394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8471266-1ac8-49ce-907f-4aae26ac103f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:13.916580 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8471266-1ac8-49ce-907f-4aae26ac103f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:13.918002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8471266-1ac8-49ce-907f-4aae26ac103f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-f8471266-1ac8-49ce-907f-4aae26ac103f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:13.935449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:13.936323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:13.942052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:13.942052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:13.942052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:13.942052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:13.942052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 515/1030] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:13.942337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b6bf-1dec-4d17-a035-151d1fa2c412 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.040834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17b6bf-1dec-4d17-a035-151d1fa2c412 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.079667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34173-3960-43aa-9187-892c263932bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.080707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34173-3960-43aa-9187-892c263932bf None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.080997 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34173-3960-43aa-9187-892c263932bf None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.081279 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e34173-3960-43aa-9187-892c263932bf None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.082057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34173-3960-43aa-9187-892c263932bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:14.082368 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34173-3960-43aa-9187-892c263932bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:14.083746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e34173-3960-43aa-9187-892c263932bf None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:14.100195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 516/1031] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:14.101238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8471266-1ac8-49ce-907f-4aae26ac103f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.199626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:14.207086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8471266-1ac8-49ce-907f-4aae26ac103f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.243170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386143bd-0bd1-499b-9081-ac488c2142ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.243973 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386143bd-0bd1-499b-9081-ac488c2142ef None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.244516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386143bd-0bd1-499b-9081-ac488c2142ef None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.244790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386143bd-0bd1-499b-9081-ac488c2142ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.252339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386143bd-0bd1-499b-9081-ac488c2142ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:14.253811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386143bd-0bd1-499b-9081-ac488c2142ef None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-386143bd-0bd1-499b-9081-ac488c2142ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:14.268041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:14.268930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:14.269852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:14.269852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:14.269852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:14.269852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:14.269852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:14.269852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:14.269852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:14.269852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:14.269852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 516/1032] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:25:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:14.274893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34173-3960-43aa-9187-892c263932bf None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.291486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:14.375573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e34173-3960-43aa-9187-892c263932bf None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.409958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6900258-9a4d-4265-a2c4-92a80bd78284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.410646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900258-9a4d-4265-a2c4-92a80bd78284 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.410929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900258-9a4d-4265-a2c4-92a80bd78284 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.411206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6900258-9a4d-4265-a2c4-92a80bd78284 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.412020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6900258-9a4d-4265-a2c4-92a80bd78284 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:14.412334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6900258-9a4d-4265-a2c4-92a80bd78284 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:14.413869 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6900258-9a4d-4265-a2c4-92a80bd78284 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:14.433281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 517/1033] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:14.434608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386143bd-0bd1-499b-9081-ac488c2142ef None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.534748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386143bd-0bd1-499b-9081-ac488c2142ef None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.567021 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012efb7-b725-4ae3-ac77-0e3d1d25e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.567671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012efb7-b725-4ae3-ac77-0e3d1d25e76c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.567954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012efb7-b725-4ae3-ac77-0e3d1d25e76c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.568228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012efb7-b725-4ae3-ac77-0e3d1d25e76c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.569050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012efb7-b725-4ae3-ac77-0e3d1d25e76c None admin] RBAC: Adding query filter params (role.id=566c06b24ff94e66bd6c851381e21e88, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=a1e4a66515654e1f9f7452740ff4ce58) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:14.569357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012efb7-b725-4ae3-ac77-0e3d1d25e76c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:14.570805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012efb7-b725-4ae3-ac77-0e3d1d25e76c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:14.581699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 517/1034] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:25:14 2022] GET /identity/v3/role_assignments?user.id=a1e4a66515654e1f9f7452740ff4ce58&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=566c06b24ff94e66bd6c851381e21e88 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:14.603968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b17e8-de75-4bc7-a7ec-438415b9c0cb None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.604246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b17e8-de75-4bc7-a7ec-438415b9c0cb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.604523 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b17e8-de75-4bc7-a7ec-438415b9c0cb None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.605971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 518/1035] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:14.612038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3af4-a7dd-475e-b6a0-d071f74682f0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.612340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3af4-a7dd-475e-b6a0-d071f74682f0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.612605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf3af4-a7dd-475e-b6a0-d071f74682f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.630550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cdbf3af4-a7dd-475e-b6a0-d071f74682f0 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:14.631830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cdbf3af4-a7dd-475e-b6a0-d071f74682f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:14.648461 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:14.706998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 518/1036] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:14.729523 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b17e8-de75-4bc7-a7ec-438415b9c0cb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.808190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:14.834595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b17e8-de75-4bc7-a7ec-438415b9c0cb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:14.870586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f304adf-65f4-49d7-b165-20afd2fa7257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:14.871373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f304adf-65f4-49d7-b165-20afd2fa7257 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:14.871655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f304adf-65f4-49d7-b165-20afd2fa7257 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:14.871929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f304adf-65f4-49d7-b165-20afd2fa7257 None admin] PATH_INFO: `/v3/services/image` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:14.872572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f304adf-65f4-49d7-b165-20afd2fa7257 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:14.874503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f304adf-65f4-49d7-b165-20afd2fa7257 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-4f304adf-65f4-49d7-b165-20afd2fa7257 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:14.886032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:14.887003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:14.887843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:14.889514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 519/1037] 10.222.0.41 () {56 vars in 1105 bytes} [Thu May 26 12:25:14 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:14.893269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf3af4-a7dd-475e-b6a0-d071f74682f0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:14.996223 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf3af4-a7dd-475e-b6a0-d071f74682f0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.031353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8556-6cc1-4336-bfb2-0adf2fa81a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.032023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8556-6cc1-4336-bfb2-0adf2fa81a4a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.032313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8556-6cc1-4336-bfb2-0adf2fa81a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.032663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d8556-6cc1-4336-bfb2-0adf2fa81a4a None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.033394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8556-6cc1-4336-bfb2-0adf2fa81a4a None admin] RBAC: Adding query filter params (name=image) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:15.033728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8556-6cc1-4336-bfb2-0adf2fa81a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.035094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d8556-6cc1-4336-bfb2-0adf2fa81a4a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.044593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 519/1038] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:15.046362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f304adf-65f4-49d7-b165-20afd2fa7257 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.156049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f304adf-65f4-49d7-b165-20afd2fa7257 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.189334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ab7d6-07a9-4b59-af74-93d358dd1555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.190032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ab7d6-07a9-4b59-af74-93d358dd1555 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.190316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ab7d6-07a9-4b59-af74-93d358dd1555 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.190592 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ab7d6-07a9-4b59-af74-93d358dd1555 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.191290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ab7d6-07a9-4b59-af74-93d358dd1555 None admin] RBAC: Adding query filter params (type=image) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:15.191595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ab7d6-07a9-4b59-af74-93d358dd1555 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.192957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ab7d6-07a9-4b59-af74-93d358dd1555 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.201826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 520/1039] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:15.204282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8556-6cc1-4336-bfb2-0adf2fa81a4a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.219402 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.282077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7327424-093f-4f58-9ae7-2b81e11af682 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.282385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7327424-093f-4f58-9ae7-2b81e11af682 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.282640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7327424-093f-4f58-9ae7-2b81e11af682 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.284117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 521/1040] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:15.288741 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a2c05-9a5c-49f8-b22e-41a62cc35444 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.289028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a2c05-9a5c-49f8-b22e-41a62cc35444 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.289305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a2c05-9a5c-49f8-b22e-41a62cc35444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.294253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.307070 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-715a2c05-9a5c-49f8-b22e-41a62cc35444 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:15.308265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-715a2c05-9a5c-49f8-b22e-41a62cc35444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:15.309550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d8556-6cc1-4336-bfb2-0adf2fa81a4a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.350004 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811f3b3-fce2-4ac6-beb7-97cb3d60633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.351040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811f3b3-fce2-4ac6-beb7-97cb3d60633e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.351975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811f3b3-fce2-4ac6-beb7-97cb3d60633e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.352465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811f3b3-fce2-4ac6-beb7-97cb3d60633e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.353456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811f3b3-fce2-4ac6-beb7-97cb3d60633e None admin] RBAC: Adding query filter params (interface=public, service_id=8d78f3c6e5ea4804bb3fb5e5d9e7b8cc, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:15.354292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811f3b3-fce2-4ac6-beb7-97cb3d60633e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.356419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811f3b3-fce2-4ac6-beb7-97cb3d60633e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.363445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 520/1041] 10.222.0.41 () {56 vars in 1251 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/endpoints?service_id=8d78f3c6e5ea4804bb3fb5e5d9e7b8cc&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:15.369502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811f3b3-fce2-4ac6-beb7-97cb3d60633e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.380126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 522/1042] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:15.405430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a2c05-9a5c-49f8-b22e-41a62cc35444 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.455020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.479837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811f3b3-fce2-4ac6-beb7-97cb3d60633e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.513655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a2c05-9a5c-49f8-b22e-41a62cc35444 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.515630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29feb8-055b-4ef7-8414-1b76fd9d6768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.516725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29feb8-055b-4ef7-8414-1b76fd9d6768 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.516725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29feb8-055b-4ef7-8414-1b76fd9d6768 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.516930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29feb8-055b-4ef7-8414-1b76fd9d6768 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.517535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29feb8-055b-4ef7-8414-1b76fd9d6768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.518920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29feb8-055b-4ef7-8414-1b76fd9d6768 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.525678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 521/1043] 10.222.0.41 () {56 vars in 1087 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:25:15.555784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.561697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480fc9b-b95c-4b1e-a378-355611254872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.562555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480fc9b-b95c-4b1e-a378-355611254872 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.562846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480fc9b-b95c-4b1e-a378-355611254872 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.563127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480fc9b-b95c-4b1e-a378-355611254872 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.564441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480fc9b-b95c-4b1e-a378-355611254872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.565911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480fc9b-b95c-4b1e-a378-355611254872 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.572850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 523/1044] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:15.573357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29feb8-055b-4ef7-8414-1b76fd9d6768 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.683189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29feb8-055b-4ef7-8414-1b76fd9d6768 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.723987 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6499f1-7544-43e3-ab52-ed3f779ceae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.724665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6499f1-7544-43e3-ab52-ed3f779ceae7 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.724952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6499f1-7544-43e3-ab52-ed3f779ceae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.725234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6499f1-7544-43e3-ab52-ed3f779ceae7 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.725983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6499f1-7544-43e3-ab52-ed3f779ceae7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.727407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6499f1-7544-43e3-ab52-ed3f779ceae7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.737517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.854135 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 522/1045] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:25:15 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:16.781304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858cd79-8cc5-4892-8302-3f33c1e674b4 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.781850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858cd79-8cc5-4892-8302-3f33c1e674b4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.781928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858cd79-8cc5-4892-8302-3f33c1e674b4 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.783408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 524/1046] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:16.788305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff716e7b-04d1-4990-95ae-0eaf97506fee None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.788700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff716e7b-04d1-4990-95ae-0eaf97506fee None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.788893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff716e7b-04d1-4990-95ae-0eaf97506fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.808812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ff716e7b-04d1-4990-95ae-0eaf97506fee None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:16.808812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ff716e7b-04d1-4990-95ae-0eaf97506fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:16.883997 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 523/1047] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:16.907305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858cd79-8cc5-4892-8302-3f33c1e674b4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.010310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858cd79-8cc5-4892-8302-3f33c1e674b4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.046414 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d554c5-d5e4-4cf4-89ed-80779785e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.047145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d554c5-d5e4-4cf4-89ed-80779785e0fa None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.047433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d554c5-d5e4-4cf4-89ed-80779785e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.047714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d554c5-d5e4-4cf4-89ed-80779785e0fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.057800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d554c5-d5e4-4cf4-89ed-80779785e0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-59d554c5-d5e4-4cf4-89ed-80779785e0fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:17.066429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:17.067421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:17.068302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 525/1048] 10.222.0.41 () {56 vars in 1120 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:17.075101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff716e7b-04d1-4990-95ae-0eaf97506fee None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.176215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff716e7b-04d1-4990-95ae-0eaf97506fee None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.201355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:17.210304 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c64034-e3b8-43cc-87ad-bb66bda4cabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.210971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c64034-e3b8-43cc-87ad-bb66bda4cabf None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.217193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c64034-e3b8-43cc-87ad-bb66bda4cabf None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.217193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c64034-e3b8-43cc-87ad-bb66bda4cabf None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.217193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c64034-e3b8-43cc-87ad-bb66bda4cabf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:17.217193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c64034-e3b8-43cc-87ad-bb66bda4cabf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.217193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c64034-e3b8-43cc-87ad-bb66bda4cabf None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.227081 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 524/1049] 10.222.0.41 () {56 vars in 1115 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:17.228281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d554c5-d5e4-4cf4-89ed-80779785e0fa None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.288697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:17.330471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d554c5-d5e4-4cf4-89ed-80779785e0fa None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.363851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05346a71-02d6-423b-8138-e7e46382230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.364636 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05346a71-02d6-423b-8138-e7e46382230e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.364926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05346a71-02d6-423b-8138-e7e46382230e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.365236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05346a71-02d6-423b-8138-e7e46382230e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.376040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05346a71-02d6-423b-8138-e7e46382230e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.377493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05346a71-02d6-423b-8138-e7e46382230e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-05346a71-02d6-423b-8138-e7e46382230e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:17.394700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:17.395616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:17.396489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:17.396489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:17.396489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:17.396489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:17.396489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 526/1050] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:17.402702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c64034-e3b8-43cc-87ad-bb66bda4cabf None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.505088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c64034-e3b8-43cc-87ad-bb66bda4cabf None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.538698 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445a035-a39d-4043-a631-0ef6001d9b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.539373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a035-a39d-4043-a631-0ef6001d9b38 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.539663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a035-a39d-4043-a631-0ef6001d9b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.539944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a035-a39d-4043-a631-0ef6001d9b38 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.540671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445a035-a39d-4043-a631-0ef6001d9b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:17.540982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445a035-a39d-4043-a631-0ef6001d9b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.542410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445a035-a39d-4043-a631-0ef6001d9b38 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.561395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 525/1051] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:17.562807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05346a71-02d6-423b-8138-e7e46382230e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.669192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05346a71-02d6-423b-8138-e7e46382230e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.682535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:17.704689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf853dc0-ff50-4f7b-a984-2919eda5cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.705488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf853dc0-ff50-4f7b-a984-2919eda5cb1c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.710210 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf853dc0-ff50-4f7b-a984-2919eda5cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.710210 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf853dc0-ff50-4f7b-a984-2919eda5cb1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.713736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf853dc0-ff50-4f7b-a984-2919eda5cb1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.715197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf853dc0-ff50-4f7b-a984-2919eda5cb1c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-bf853dc0-ff50-4f7b-a984-2919eda5cb1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:17.729787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:17.730750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:17.731789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 527/1052] 10.222.0.41 () {56 vars in 1093 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:17.738339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445a035-a39d-4043-a631-0ef6001d9b38 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.746183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9fd04-0ad3-4b98-a547-0401b828b67f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.746479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9fd04-0ad3-4b98-a547-0401b828b67f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.746762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b9fd04-0ad3-4b98-a547-0401b828b67f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.749213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 528/1053] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:17.754397 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e366d0-eac0-4012-a47f-2050239b7f83 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.754726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e366d0-eac0-4012-a47f-2050239b7f83 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.754982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e366d0-eac0-4012-a47f-2050239b7f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.772665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-14e366d0-eac0-4012-a47f-2050239b7f83 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:17.773896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-14e366d0-eac0-4012-a47f-2050239b7f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:17.791416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:17.843873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 529/1054] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:17.844588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445a035-a39d-4043-a631-0ef6001d9b38 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.865995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e366d0-eac0-4012-a47f-2050239b7f83 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.881985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d086b19-2a3e-4b34-93cd-6a59812c8909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.882940 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d086b19-2a3e-4b34-93cd-6a59812c8909 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.883235 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d086b19-2a3e-4b34-93cd-6a59812c8909 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.883517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d086b19-2a3e-4b34-93cd-6a59812c8909 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.884540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d086b19-2a3e-4b34-93cd-6a59812c8909 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:17.885152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d086b19-2a3e-4b34-93cd-6a59812c8909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.886604 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d086b19-2a3e-4b34-93cd-6a59812c8909 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.909070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 526/1055] 10.222.0.41 () {56 vars in 1133 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:17.910011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d086b19-2a3e-4b34-93cd-6a59812c8909 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.979170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e366d0-eac0-4012-a47f-2050239b7f83 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.981412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:18.016682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d086b19-2a3e-4b34-93cd-6a59812c8909 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.018663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237a2fc-93f0-4ea9-ac33-dd34ed208946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.019464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a2fc-93f0-4ea9-ac33-dd34ed208946 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.019749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a2fc-93f0-4ea9-ac33-dd34ed208946 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.020031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237a2fc-93f0-4ea9-ac33-dd34ed208946 None admin] PATH_INFO: `/v3/services/image` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.020688 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237a2fc-93f0-4ea9-ac33-dd34ed208946 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.022104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237a2fc-93f0-4ea9-ac33-dd34ed208946 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.025950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-0237a2fc-93f0-4ea9-ac33-dd34ed208946 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:18.034377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:18.036988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:18.037877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 530/1056] 10.222.0.41 () {56 vars in 1105 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:18.041373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237a2fc-93f0-4ea9-ac33-dd34ed208946 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.055588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0e03f-71f8-436b-b6a8-28958d127925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.056516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0e03f-71f8-436b-b6a8-28958d127925 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.056801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0e03f-71f8-436b-b6a8-28958d127925 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.057078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0e03f-71f8-436b-b6a8-28958d127925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.068329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0e03f-71f8-436b-b6a8-28958d127925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.069819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0e03f-71f8-436b-b6a8-28958d127925 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-1ab0e03f-71f8-436b-b6a8-28958d127925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:18.087617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:18.088722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:18.089642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:18.089642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:18.089642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:18.089642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:18.089642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 527/1057] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:18.094746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0e03f-71f8-436b-b6a8-28958d127925 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.157542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237a2fc-93f0-4ea9-ac33-dd34ed208946 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.190388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb23491-8b11-4e4a-abab-062f544a7dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.191050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23491-8b11-4e4a-abab-062f544a7dee None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.191338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23491-8b11-4e4a-abab-062f544a7dee None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.191618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb23491-8b11-4e4a-abab-062f544a7dee None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.192327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb23491-8b11-4e4a-abab-062f544a7dee None admin] RBAC: Adding query filter params (name=image) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:18.192641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb23491-8b11-4e4a-abab-062f544a7dee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.194037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb23491-8b11-4e4a-abab-062f544a7dee None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.198912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 531/1058] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:18.200160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007edbf-d57b-4b2c-8da3-b1ab548cbb5e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.200454 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007edbf-d57b-4b2c-8da3-b1ab548cbb5e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.200735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007edbf-d57b-4b2c-8da3-b1ab548cbb5e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.202671 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 532/1059] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:18.203325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0e03f-71f8-436b-b6a8-28958d127925 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.206538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007edbf-d57b-4b2c-8da3-b1ab548cbb5e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.236097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:18.236739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9dc3a-e323-4f33-af2c-718575087936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.237399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9dc3a-e323-4f33-af2c-718575087936 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.237691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9dc3a-e323-4f33-af2c-718575087936 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.237983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9dc3a-e323-4f33-af2c-718575087936 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.238697 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9dc3a-e323-4f33-af2c-718575087936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:18.239003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9dc3a-e323-4f33-af2c-718575087936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.240355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9dc3a-e323-4f33-af2c-718575087936 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.251738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 528/1060] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:18.253547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d97e47-9b9a-4441-b367-c91700d171b9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.253547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d97e47-9b9a-4441-b367-c91700d171b9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.253547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d97e47-9b9a-4441-b367-c91700d171b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.269544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f4d97e47-9b9a-4441-b367-c91700d171b9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:18.270936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f4d97e47-9b9a-4441-b367-c91700d171b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:18.284373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:18.310572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007edbf-d57b-4b2c-8da3-b1ab548cbb5e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.336275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 529/1061] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:18.337228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d97e47-9b9a-4441-b367-c91700d171b9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.353400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342f743-4434-4a78-8847-77b5088fe523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.354106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f743-4434-4a78-8847-77b5088fe523 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.354554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f743-4434-4a78-8847-77b5088fe523 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.354839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f743-4434-4a78-8847-77b5088fe523 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.355839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342f743-4434-4a78-8847-77b5088fe523 None admin] RBAC: Adding query filter params (type=image) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:18.356153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342f743-4434-4a78-8847-77b5088fe523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.358157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342f743-4434-4a78-8847-77b5088fe523 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.363624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 533/1062] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:18.364294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342f743-4434-4a78-8847-77b5088fe523 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.438099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d97e47-9b9a-4441-b367-c91700d171b9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.457812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:18.464024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342f743-4434-4a78-8847-77b5088fe523 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.472355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b77d5-d1e8-4cfd-b70d-d2ae969872b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.476532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b77d5-d1e8-4cfd-b70d-d2ae969872b4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.476532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b77d5-d1e8-4cfd-b70d-d2ae969872b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.476532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b77d5-d1e8-4cfd-b70d-d2ae969872b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.480294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b77d5-d1e8-4cfd-b70d-d2ae969872b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.481830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b77d5-d1e8-4cfd-b70d-d2ae969872b4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-275b77d5-d1e8-4cfd-b70d-d2ae969872b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:18.495560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:18.496491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:18.497393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:18.497393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:18.497393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:18.497393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:18.497393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:18.497393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:18.497393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:18.497393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:18.497393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 530/1063] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:18.497393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b77d5-d1e8-4cfd-b70d-d2ae969872b4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.503444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717e06c-b135-4517-ac7f-4d861b88132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.504238 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717e06c-b135-4517-ac7f-4d861b88132a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.504551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717e06c-b135-4517-ac7f-4d861b88132a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.504830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717e06c-b135-4517-ac7f-4d861b88132a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.512029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:18.515698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717e06c-b135-4517-ac7f-4d861b88132a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-9717e06c-b135-4517-ac7f-4d861b88132a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:18.523278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:18.529743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 534/1064] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:18.530590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717e06c-b135-4517-ac7f-4d861b88132a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.600667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b77d5-d1e8-4cfd-b70d-d2ae969872b4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.623938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717e06c-b135-4517-ac7f-4d861b88132a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.633828 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe77d5c-90c7-437f-87d2-da7d7d05bcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.634467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe77d5c-90c7-437f-87d2-da7d7d05bcc0 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.634750 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe77d5c-90c7-437f-87d2-da7d7d05bcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.635025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe77d5c-90c7-437f-87d2-da7d7d05bcc0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.635824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe77d5c-90c7-437f-87d2-da7d7d05bcc0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.637185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe77d5c-90c7-437f-87d2-da7d7d05bcc0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.657303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbe75c-4448-44ae-b128-5b25369ca879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.658051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbe75c-4448-44ae-b128-5b25369ca879 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.658333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbe75c-4448-44ae-b128-5b25369ca879 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.658607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cbe75c-4448-44ae-b128-5b25369ca879 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.659385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbe75c-4448-44ae-b128-5b25369ca879 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:18.659689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbe75c-4448-44ae-b128-5b25369ca879 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.661103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cbe75c-4448-44ae-b128-5b25369ca879 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.672887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 535/1065] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:18.673690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbe75c-4448-44ae-b128-5b25369ca879 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.688731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:18.756943 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 531/1066] 10.222.0.41 () {60 vars in 1144 bytes} [Thu May 26 12:25:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:18.757701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe77d5c-90c7-437f-87d2-da7d7d05bcc0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.843363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:18.859462 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cbe75c-4448-44ae-b128-5b25369ca879 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.896540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe77d5c-90c7-437f-87d2-da7d7d05bcc0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:18.898208 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3615c48-5fee-4265-aa53-c2533975d1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.898955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615c48-5fee-4265-aa53-c2533975d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.899239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615c48-5fee-4265-aa53-c2533975d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.899520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3615c48-5fee-4265-aa53-c2533975d1f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.900295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3615c48-5fee-4265-aa53-c2533975d1f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:18.900606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3615c48-5fee-4265-aa53-c2533975d1f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.902025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3615c48-5fee-4265-aa53-c2533975d1f5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.912318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 536/1067] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:18.917883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3615c48-5fee-4265-aa53-c2533975d1f5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:18.941967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e8403-bbda-40d1-b967-580eed8ff5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:18.942952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8403-bbda-40d1-b967-580eed8ff5c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:18.943242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8403-bbda-40d1-b967-580eed8ff5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:18.943518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8403-bbda-40d1-b967-580eed8ff5c3 None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/a1e4a66515654e1f9f7452740ff4ce58/roles/566c06b24ff94e66bd6c851381e21e88` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:18.945815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e8403-bbda-40d1-b967-580eed8ff5c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=a1e4a66515654e1f9f7452740ff4ce58, role_id=566c06b24ff94e66bd6c851381e21e88)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:18.947254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e8403-bbda-40d1-b967-580eed8ff5c3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:18.999623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.032461 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 532/1068] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:25:18 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/a1e4a66515654e1f9f7452740ff4ce58/roles/566c06b24ff94e66bd6c851381e21e88 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:19.032681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3615c48-5fee-4265-aa53-c2533975d1f5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.060832 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e4e4-42ab-4afe-bac3-685780946ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.061762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e4e4-42ab-4afe-bac3-685780946ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.062056 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e4e4-42ab-4afe-bac3-685780946ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.062336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8e4e4-42ab-4afe-bac3-685780946ab4 None admin] PATH_INFO: `/v3/users/93f800db9bd448aabfdfbf47ceb585e1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.083782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8e4e4-42ab-4afe-bac3-685780946ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=93f800db9bd448aabfdfbf47ceb585e1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.085297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8e4e4-42ab-4afe-bac3-685780946ab4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.087399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 537/1069] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:18 2022] GET /identity/v3/users/93f800db9bd448aabfdfbf47ceb585e1 => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:19.093779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e8403-bbda-40d1-b967-580eed8ff5c3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.203998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e8403-bbda-40d1-b967-580eed8ff5c3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.228542 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.242611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f6f7-e6d8-4183-98c8-35636e96735a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.243665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f6f7-e6d8-4183-98c8-35636e96735a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.243665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f6f7-e6d8-4183-98c8-35636e96735a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.243848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01f6f7-e6d8-4183-98c8-35636e96735a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.313989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01f6f7-e6d8-4183-98c8-35636e96735a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.315350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01f6f7-e6d8-4183-98c8-35636e96735a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.418327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 533/1070] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:19.419538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e4e4-42ab-4afe-bac3-685780946ab4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.524738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8e4e4-42ab-4afe-bac3-685780946ab4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.566170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d420c1-3799-4efb-83ed-3314d7b3f9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.566954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d420c1-3799-4efb-83ed-3314d7b3f9fd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.567234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d420c1-3799-4efb-83ed-3314d7b3f9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.567509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d420c1-3799-4efb-83ed-3314d7b3f9fd None admin] PATH_INFO: `/v3/projects/d06aeec5c0e048e39488d97549aa86f6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.568671 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d420c1-3799-4efb-83ed-3314d7b3f9fd None admin] RBAC: Authorizing `identity:get_project(project_id=d06aeec5c0e048e39488d97549aa86f6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.570142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d420c1-3799-4efb-83ed-3314d7b3f9fd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.576485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 538/1071] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/projects/d06aeec5c0e048e39488d97549aa86f6 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:19.577957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f6f7-e6d8-4183-98c8-35636e96735a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.599392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.678646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01f6f7-e6d8-4183-98c8-35636e96735a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.712328 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2d290-a37e-44be-a50d-7c2b4e25a39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.712978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d290-a37e-44be-a50d-7c2b4e25a39b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.713260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d290-a37e-44be-a50d-7c2b4e25a39b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.713537 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d290-a37e-44be-a50d-7c2b4e25a39b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.714459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d290-a37e-44be-a50d-7c2b4e25a39b None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=d06aeec5c0e048e39488d97549aa86f6, user.id=93f800db9bd448aabfdfbf47ceb585e1) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:19.714771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d290-a37e-44be-a50d-7c2b4e25a39b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.716187 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2d290-a37e-44be-a50d-7c2b4e25a39b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.729946 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 534/1072] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/role_assignments?user.id=93f800db9bd448aabfdfbf47ceb585e1&scope.project.id=d06aeec5c0e048e39488d97549aa86f6&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:20.977153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea25c4-3367-4b1a-ba25-a14c81f20019 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.977716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea25c4-3367-4b1a-ba25-a14c81f20019 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.977716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea25c4-3367-4b1a-ba25-a14c81f20019 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.979109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 539/1073] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:20.984212 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5155-9493-4673-9241-1f36f5a4bca7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.984601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5155-9493-4673-9241-1f36f5a4bca7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.984768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e5155-9493-4673-9241-1f36f5a4bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.001867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-711e5155-9493-4673-9241-1f36f5a4bca7 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:21.003037 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-711e5155-9493-4673-9241-1f36f5a4bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:21.069046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 535/1074] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:21.091496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea25c4-3367-4b1a-ba25-a14c81f20019 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.094452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.195762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea25c4-3367-4b1a-ba25-a14c81f20019 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.229904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8d1d3-940c-4aca-92b3-d106b58fec9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.230484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8d1d3-940c-4aca-92b3-d106b58fec9a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.230769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8d1d3-940c-4aca-92b3-d106b58fec9a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.231049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8d1d3-940c-4aca-92b3-d106b58fec9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.259587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00400711-444d-417e-8eb9-70b554a90e21 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.259975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00400711-444d-417e-8eb9-70b554a90e21 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.260329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00400711-444d-417e-8eb9-70b554a90e21 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.261804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 536/1075] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:21.266756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ee43c-8a5a-4c8b-b22a-0c8669d7d734 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.267043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ee43c-8a5a-4c8b-b22a-0c8669d7d734 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.267323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ee43c-8a5a-4c8b-b22a-0c8669d7d734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.285030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d20ee43c-8a5a-4c8b-b22a-0c8669d7d734 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:21.286474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d20ee43c-8a5a-4c8b-b22a-0c8669d7d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:21.298774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.313535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8d1d3-940c-4aca-92b3-d106b58fec9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.315134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8d1d3-940c-4aca-92b3-d106b58fec9a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.317067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.356491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 537/1076] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:21.380895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ee43c-8a5a-4c8b-b22a-0c8669d7d734 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.425698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 540/1077] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:21.431426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8d1d3-940c-4aca-92b3-d106b58fec9a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.498435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ee43c-8a5a-4c8b-b22a-0c8669d7d734 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.540236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3c826-835b-48ca-9ce1-2ce6b7e58bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.540479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8d1d3-940c-4aca-92b3-d106b58fec9a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.541427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3c826-835b-48ca-9ce1-2ce6b7e58bbc None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.541895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.542201 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3c826-835b-48ca-9ce1-2ce6b7e58bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.542488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3c826-835b-48ca-9ce1-2ce6b7e58bbc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.555623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3c826-835b-48ca-9ce1-2ce6b7e58bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-15a3c826-835b-48ca-9ce1-2ce6b7e58bbc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:21.563912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:21.564868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:21.565730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 538/1078] 10.222.0.41 () {56 vars in 1120 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:21.576947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3c826-835b-48ca-9ce1-2ce6b7e58bbc None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.579010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.585075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b93fe-ae84-4c5d-8d59-4bb0ae6cad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.586264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b93fe-ae84-4c5d-8d59-4bb0ae6cad2f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.586561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b93fe-ae84-4c5d-8d59-4bb0ae6cad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.586844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b93fe-ae84-4c5d-8d59-4bb0ae6cad2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.597694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b93fe-ae84-4c5d-8d59-4bb0ae6cad2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.599298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b93fe-ae84-4c5d-8d59-4bb0ae6cad2f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-524b93fe-ae84-4c5d-8d59-4bb0ae6cad2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:21.619352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:21.620255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:21.621161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:21.621161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:21.621161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.621161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:21.625634 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 541/1079] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:21.626486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b93fe-ae84-4c5d-8d59-4bb0ae6cad2f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.684634 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3c826-835b-48ca-9ce1-2ce6b7e58bbc None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.726447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1513a6b-7510-47ba-9c2d-25359f31f9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.727143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1513a6b-7510-47ba-9c2d-25359f31f9ce None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.727429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1513a6b-7510-47ba-9c2d-25359f31f9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.727707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1513a6b-7510-47ba-9c2d-25359f31f9ce None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.728480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1513a6b-7510-47ba-9c2d-25359f31f9ce None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:21.728792 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1513a6b-7510-47ba-9c2d-25359f31f9ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.730251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1513a6b-7510-47ba-9c2d-25359f31f9ce None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.736063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b93fe-ae84-4c5d-8d59-4bb0ae6cad2f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.740357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 539/1080] 10.222.0.41 () {56 vars in 1115 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:21.746174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1513a6b-7510-47ba-9c2d-25359f31f9ce None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.771506 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d95ec-4df1-4158-9d4c-d33e7bcca80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.772098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d95ec-4df1-4158-9d4c-d33e7bcca80f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.772387 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d95ec-4df1-4158-9d4c-d33e7bcca80f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.772671 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d95ec-4df1-4158-9d4c-d33e7bcca80f None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.773391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d95ec-4df1-4158-9d4c-d33e7bcca80f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:21.773728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d95ec-4df1-4158-9d4c-d33e7bcca80f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.775095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d95ec-4df1-4158-9d4c-d33e7bcca80f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.787138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 542/1081] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:21.828693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.868145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1513a6b-7510-47ba-9c2d-25359f31f9ce None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.899669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f5e6-1020-4f09-8c6f-57df0a62de4a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.900086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f5e6-1020-4f09-8c6f-57df0a62de4a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.900375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2882f5e6-1020-4f09-8c6f-57df0a62de4a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.901932 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 543/1082] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:21.906585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16ab51-6969-4259-a87b-96fcea6330d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.907276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3925f15-5016-4616-824f-eebdb3ccc8ae None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.907487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16ab51-6969-4259-a87b-96fcea6330d8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.907582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3925f15-5016-4616-824f-eebdb3ccc8ae None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.907745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16ab51-6969-4259-a87b-96fcea6330d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.907836 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3925f15-5016-4616-824f-eebdb3ccc8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.908019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b16ab51-6969-4259-a87b-96fcea6330d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.920339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16ab51-6969-4259-a87b-96fcea6330d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.921866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b16ab51-6969-4259-a87b-96fcea6330d8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.925317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d3925f15-5016-4616-824f-eebdb3ccc8ae None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:21.926570 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d3925f15-5016-4616-824f-eebdb3ccc8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:21.937620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-9b16ab51-6969-4259-a87b-96fcea6330d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:21.940823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:21.941979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:21.942956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:21.942956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:21.942956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.942956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:21.945892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 540/1083] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:21.947928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16ab51-6969-4259-a87b-96fcea6330d8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.004696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 544/1084] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:22.026598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3925f15-5016-4616-824f-eebdb3ccc8ae None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.068005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b16ab51-6969-4259-a87b-96fcea6330d8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.091868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.110445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6380c-4922-48b3-a2d1-118986f30142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.111213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6380c-4922-48b3-a2d1-118986f30142 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.111506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6380c-4922-48b3-a2d1-118986f30142 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.111783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6380c-4922-48b3-a2d1-118986f30142 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.112569 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6380c-4922-48b3-a2d1-118986f30142 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.112881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6380c-4922-48b3-a2d1-118986f30142 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.114350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6380c-4922-48b3-a2d1-118986f30142 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.127176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 541/1085] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:22.132766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6380c-4922-48b3-a2d1-118986f30142 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.141457 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3925f15-5016-4616-824f-eebdb3ccc8ae None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.175963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bb232-bb6c-4a6d-95c5-bcbfd52628d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.176753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bb232-bb6c-4a6d-95c5-bcbfd52628d2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.177036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bb232-bb6c-4a6d-95c5-bcbfd52628d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.177315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bb232-bb6c-4a6d-95c5-bcbfd52628d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.187615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bb232-bb6c-4a6d-95c5-bcbfd52628d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-7e0bb232-bb6c-4a6d-95c5-bcbfd52628d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:22.195153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:22.196069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:22.196897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 545/1086] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:22.202339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bb232-bb6c-4a6d-95c5-bcbfd52628d2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.205774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.231293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6380c-4922-48b3-a2d1-118986f30142 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.266160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebec007-6f1b-48cd-b6eb-e6888b5b858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.266945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec007-6f1b-48cd-b6eb-e6888b5b858d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.267229 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec007-6f1b-48cd-b6eb-e6888b5b858d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.267505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebec007-6f1b-48cd-b6eb-e6888b5b858d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.274565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebec007-6f1b-48cd-b6eb-e6888b5b858d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.276011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebec007-6f1b-48cd-b6eb-e6888b5b858d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2ebec007-6f1b-48cd-b6eb-e6888b5b858d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:22.290702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:22.291642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:22.292602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 542/1087] 10.222.0.41 () {56 vars in 1093 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:22.298115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebec007-6f1b-48cd-b6eb-e6888b5b858d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.301082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bb232-bb6c-4a6d-95c5-bcbfd52628d2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.333566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f600af-f7a6-4304-bc22-384775f4422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.334262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f600af-f7a6-4304-bc22-384775f4422e None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.334553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f600af-f7a6-4304-bc22-384775f4422e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.334835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f600af-f7a6-4304-bc22-384775f4422e None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.335579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f600af-f7a6-4304-bc22-384775f4422e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.335888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f600af-f7a6-4304-bc22-384775f4422e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.336597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.337260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f600af-f7a6-4304-bc22-384775f4422e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.345948 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 546/1088] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:22.351821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f600af-f7a6-4304-bc22-384775f4422e None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.396197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebec007-6f1b-48cd-b6eb-e6888b5b858d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.416788 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.430457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4eb99-2aca-4e53-bf1a-8b3f31283b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.431125 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4eb99-2aca-4e53-bf1a-8b3f31283b05 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.431411 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4eb99-2aca-4e53-bf1a-8b3f31283b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.431691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4eb99-2aca-4e53-bf1a-8b3f31283b05 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.432521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4eb99-2aca-4e53-bf1a-8b3f31283b05 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.432835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4eb99-2aca-4e53-bf1a-8b3f31283b05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.434319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4eb99-2aca-4e53-bf1a-8b3f31283b05 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.451029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 543/1089] 10.222.0.41 () {56 vars in 1133 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:22.451184 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f600af-f7a6-4304-bc22-384775f4422e None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.456702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4eb99-2aca-4e53-bf1a-8b3f31283b05 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.485123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479211c5-b536-4c16-adf0-973bcfaaa5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.486034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479211c5-b536-4c16-adf0-973bcfaaa5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.486319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479211c5-b536-4c16-adf0-973bcfaaa5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.486595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479211c5-b536-4c16-adf0-973bcfaaa5b0 None admin] PATH_INFO: `/v3/users/93f800db9bd448aabfdfbf47ceb585e1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.487795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479211c5-b536-4c16-adf0-973bcfaaa5b0 None admin] RBAC: Authorizing `identity:get_user(user_id=93f800db9bd448aabfdfbf47ceb585e1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.489221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479211c5-b536-4c16-adf0-973bcfaaa5b0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.490862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 547/1090] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/users/93f800db9bd448aabfdfbf47ceb585e1 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:22.496547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479211c5-b536-4c16-adf0-973bcfaaa5b0 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.550252 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.556067 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4eb99-2aca-4e53-bf1a-8b3f31283b05 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.589180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd49f-a67a-4947-ba0c-bf5fbfc20485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.589858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd49f-a67a-4947-ba0c-bf5fbfc20485 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.590155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd49f-a67a-4947-ba0c-bf5fbfc20485 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.590439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401fd49f-a67a-4947-ba0c-bf5fbfc20485 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.593696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479211c5-b536-4c16-adf0-973bcfaaa5b0 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.627263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23a9a8-adaa-416f-be3c-37846346f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.628107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23a9a8-adaa-416f-be3c-37846346f2eb None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.628391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23a9a8-adaa-416f-be3c-37846346f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.628668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd23a9a8-adaa-416f-be3c-37846346f2eb None admin] PATH_INFO: `/v3/projects/d06aeec5c0e048e39488d97549aa86f6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.629859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23a9a8-adaa-416f-be3c-37846346f2eb None admin] RBAC: Authorizing `identity:get_project(project_id=d06aeec5c0e048e39488d97549aa86f6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.631286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd23a9a8-adaa-416f-be3c-37846346f2eb None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.632969 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 548/1091] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/projects/d06aeec5c0e048e39488d97549aa86f6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:22.639285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23a9a8-adaa-416f-be3c-37846346f2eb None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.641804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.657544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fd49f-a67a-4947-ba0c-bf5fbfc20485 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.659086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401fd49f-a67a-4947-ba0c-bf5fbfc20485 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.736850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd23a9a8-adaa-416f-be3c-37846346f2eb None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.748601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.759864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 544/1092] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:22.762148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd49f-a67a-4947-ba0c-bf5fbfc20485 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.769539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d9ae0-b3e9-415b-ad5d-4f9b509b8178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.770442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d9ae0-b3e9-415b-ad5d-4f9b509b8178 None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.770726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d9ae0-b3e9-415b-ad5d-4f9b509b8178 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.771003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d9ae0-b3e9-415b-ad5d-4f9b509b8178 None admin] PATH_INFO: `/v3/projects/d06aeec5c0e048e39488d97549aa86f6/users/93f800db9bd448aabfdfbf47ceb585e1/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.772991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d9ae0-b3e9-415b-ad5d-4f9b509b8178 None admin] RBAC: Authorizing `identity:create_grant(project_id=d06aeec5c0e048e39488d97549aa86f6, user_id=93f800db9bd448aabfdfbf47ceb585e1, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.774436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d9ae0-b3e9-415b-ad5d-4f9b509b8178 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.853746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 549/1093] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:25:22 2022] PUT /identity/v3/projects/d06aeec5c0e048e39488d97549aa86f6/users/93f800db9bd448aabfdfbf47ceb585e1/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:25:22.855961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401fd49f-a67a-4947-ba0c-bf5fbfc20485 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.893542 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc8993-fab0-45cc-899e-668029fd019f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.894379 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc8993-fab0-45cc-899e-668029fd019f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.894661 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc8993-fab0-45cc-899e-668029fd019f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.894933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cc8993-fab0-45cc-899e-668029fd019f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.906563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc8993-fab0-45cc-899e-668029fd019f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.908045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cc8993-fab0-45cc-899e-668029fd019f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c0cc8993-fab0-45cc-899e-668029fd019f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:22.927126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:22.928279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:22.929498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:22.929498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:22.929498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:22.929498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:22.929498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 545/1094] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:22.934339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d9ae0-b3e9-415b-ad5d-4f9b509b8178 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.998854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.042236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d9ae0-b3e9-415b-ad5d-4f9b509b8178 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.077331 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43cb9a-0e9e-4c44-90b9-3eb1ab003239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.078053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43cb9a-0e9e-4c44-90b9-3eb1ab003239 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.078336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43cb9a-0e9e-4c44-90b9-3eb1ab003239 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.078612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43cb9a-0e9e-4c44-90b9-3eb1ab003239 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.079349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43cb9a-0e9e-4c44-90b9-3eb1ab003239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:23.079644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43cb9a-0e9e-4c44-90b9-3eb1ab003239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.081017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43cb9a-0e9e-4c44-90b9-3eb1ab003239 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.092881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 550/1095] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:23.098693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc8993-fab0-45cc-899e-668029fd019f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.147999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.196978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cc8993-fab0-45cc-899e-668029fd019f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.230091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd258316-cd50-4e30-9483-954d071c3356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.230881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd258316-cd50-4e30-9483-954d071c3356 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.231167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd258316-cd50-4e30-9483-954d071c3356 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.231445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd258316-cd50-4e30-9483-954d071c3356 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.238352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd258316-cd50-4e30-9483-954d071c3356 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.239798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd258316-cd50-4e30-9483-954d071c3356 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-cd258316-cd50-4e30-9483-954d071c3356 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:23.254040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:23.254886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:23.255749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:23.255749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:23.255749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:23.255749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:23.255749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:23.255749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:23.255749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:23.255749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:23.257814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 546/1096] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:23.261133 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43cb9a-0e9e-4c44-90b9-3eb1ab003239 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.362745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43cb9a-0e9e-4c44-90b9-3eb1ab003239 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.385230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.397020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375aaa9e-07b0-497b-ab6a-c59ef54fa84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.397702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aaa9e-07b0-497b-ab6a-c59ef54fa84f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.397995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aaa9e-07b0-497b-ab6a-c59ef54fa84f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.398444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375aaa9e-07b0-497b-ab6a-c59ef54fa84f None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.399059 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aaa9e-07b0-497b-ab6a-c59ef54fa84f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:23.399369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aaa9e-07b0-497b-ab6a-c59ef54fa84f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.400803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375aaa9e-07b0-497b-ab6a-c59ef54fa84f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.413383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 551/1097] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:23.418721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd258316-cd50-4e30-9483-954d071c3356 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.518293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd258316-cd50-4e30-9483-954d071c3356 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.528681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.552954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0ce5a-5059-405a-9708-6af3de6f3f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.553682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ce5a-5059-405a-9708-6af3de6f3f0f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.553978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ce5a-5059-405a-9708-6af3de6f3f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.554259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0ce5a-5059-405a-9708-6af3de6f3f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.555088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0ce5a-5059-405a-9708-6af3de6f3f0f None admin] RBAC: Adding query filter params (role.id=566c06b24ff94e66bd6c851381e21e88, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=a1e4a66515654e1f9f7452740ff4ce58) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:23.555406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0ce5a-5059-405a-9708-6af3de6f3f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.556830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0ce5a-5059-405a-9708-6af3de6f3f0f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.563448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 547/1098] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/role_assignments?user.id=a1e4a66515654e1f9f7452740ff4ce58&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=566c06b24ff94e66bd6c851381e21e88 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:25.018881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1812b-b83c-4c03-91ad-4565c85bf682 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.019408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1812b-b83c-4c03-91ad-4565c85bf682 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.019408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1812b-b83c-4c03-91ad-4565c85bf682 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.020776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 552/1099] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:25.025868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff749fac-a833-4f73-a8f9-f3c7957bf478 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.026288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff749fac-a833-4f73-a8f9-f3c7957bf478 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.026433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff749fac-a833-4f73-a8f9-f3c7957bf478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.043258 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ff749fac-a833-4f73-a8f9-f3c7957bf478 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:25.044468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ff749fac-a833-4f73-a8f9-f3c7957bf478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:25.109295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 548/1100] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:25.132389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1812b-b83c-4c03-91ad-4565c85bf682 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.231334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1812b-b83c-4c03-91ad-4565c85bf682 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.264500 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c62a44-11a2-4717-82fa-7510b528d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.265271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c62a44-11a2-4717-82fa-7510b528d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.265555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c62a44-11a2-4717-82fa-7510b528d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.265861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c62a44-11a2-4717-82fa-7510b528d6e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.275972 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c62a44-11a2-4717-82fa-7510b528d6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b2c62a44-11a2-4717-82fa-7510b528d6e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:25.283531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:25.284606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:25.285833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 553/1101] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:25.290603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff749fac-a833-4f73-a8f9-f3c7957bf478 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.385656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff749fac-a833-4f73-a8f9-f3c7957bf478 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.387164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.418532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff97200-a8f4-41e0-b625-190389941a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.419433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff97200-a8f4-41e0-b625-190389941a9a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.419903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff97200-a8f4-41e0-b625-190389941a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.420470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff97200-a8f4-41e0-b625-190389941a9a None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.421283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff97200-a8f4-41e0-b625-190389941a9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:25.421660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff97200-a8f4-41e0-b625-190389941a9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.423117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff97200-a8f4-41e0-b625-190389941a9a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.431026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 549/1102] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:25.437173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c62a44-11a2-4717-82fa-7510b528d6e1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.478503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.532449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c62a44-11a2-4717-82fa-7510b528d6e1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.565186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b6def-24e9-4de7-b342-51d41b0ace7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.566066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b6def-24e9-4de7-b342-51d41b0ace7c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.566347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b6def-24e9-4de7-b342-51d41b0ace7c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.566623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b6def-24e9-4de7-b342-51d41b0ace7c None admin] PATH_INFO: `/v3/users/93f800db9bd448aabfdfbf47ceb585e1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.567778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b6def-24e9-4de7-b342-51d41b0ace7c None admin] RBAC: Authorizing `identity:get_user(user_id=93f800db9bd448aabfdfbf47ceb585e1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.569201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b6def-24e9-4de7-b342-51d41b0ace7c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.570864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 554/1103] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/users/93f800db9bd448aabfdfbf47ceb585e1 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:25.577131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff97200-a8f4-41e0-b625-190389941a9a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.682132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff97200-a8f4-41e0-b625-190389941a9a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.715034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa18686-a15b-4b12-a89e-e6a8f118407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.715665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18686-a15b-4b12-a89e-e6a8f118407a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.715949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18686-a15b-4b12-a89e-e6a8f118407a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.716244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa18686-a15b-4b12-a89e-e6a8f118407a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.746672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.781847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa18686-a15b-4b12-a89e-e6a8f118407a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.783330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa18686-a15b-4b12-a89e-e6a8f118407a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.878883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 550/1104] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:25.884754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b6def-24e9-4de7-b342-51d41b0ace7c None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.979150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b6def-24e9-4de7-b342-51d41b0ace7c None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.989308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:26.011818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99820c-e847-4e29-8c96-e2fac6a39453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.012656 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99820c-e847-4e29-8c96-e2fac6a39453 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.012940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99820c-e847-4e29-8c96-e2fac6a39453 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.013951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99820c-e847-4e29-8c96-e2fac6a39453 None admin] PATH_INFO: `/v3/projects/d06aeec5c0e048e39488d97549aa86f6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.015027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99820c-e847-4e29-8c96-e2fac6a39453 None admin] RBAC: Authorizing `identity:get_project(project_id=d06aeec5c0e048e39488d97549aa86f6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.016446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99820c-e847-4e29-8c96-e2fac6a39453 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.018447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 555/1105] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/projects/d06aeec5c0e048e39488d97549aa86f6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:26.024080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa18686-a15b-4b12-a89e-e6a8f118407a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:26.084643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:26.120146 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa18686-a15b-4b12-a89e-e6a8f118407a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.153443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c266c-c900-4300-a7a3-f7b60a731b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.154663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c266c-c900-4300-a7a3-f7b60a731b49 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.154933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c266c-c900-4300-a7a3-f7b60a731b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.155211 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c266c-c900-4300-a7a3-f7b60a731b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.156028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c266c-c900-4300-a7a3-f7b60a731b49 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=d06aeec5c0e048e39488d97549aa86f6, user.id=93f800db9bd448aabfdfbf47ceb585e1) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:26.156341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c266c-c900-4300-a7a3-f7b60a731b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.157784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c266c-c900-4300-a7a3-f7b60a731b49 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.163554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 551/1106] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:25:26 2022] GET /identity/v3/role_assignments?user.id=93f800db9bd448aabfdfbf47ceb585e1&scope.project.id=d06aeec5c0e048e39488d97549aa86f6&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:28.379629 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad80b0-7d34-461d-834b-3118d765dc9c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.380136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad80b0-7d34-461d-834b-3118d765dc9c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.380246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad80b0-7d34-461d-834b-3118d765dc9c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.381521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 556/1107] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:28.386781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238def43-66ff-44e7-944f-97bec4f46dba None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.387157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238def43-66ff-44e7-944f-97bec4f46dba None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.387347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238def43-66ff-44e7-944f-97bec4f46dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.404177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-238def43-66ff-44e7-944f-97bec4f46dba None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:28.405373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-238def43-66ff-44e7-944f-97bec4f46dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:28.469789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 552/1108] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:28.494289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad80b0-7d34-461d-834b-3118d765dc9c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.592100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad80b0-7d34-461d-834b-3118d765dc9c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.624648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ddfc9-e4e8-4c66-b46f-0a3cbda76f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.625419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ddfc9-e4e8-4c66-b46f-0a3cbda76f3c None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.625722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ddfc9-e4e8-4c66-b46f-0a3cbda76f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.625999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ddfc9-e4e8-4c66-b46f-0a3cbda76f3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.627222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ddfc9-e4e8-4c66-b46f-0a3cbda76f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.628653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ddfc9-e4e8-4c66-b46f-0a3cbda76f3c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.635444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 557/1109] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:28.635889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238def43-66ff-44e7-944f-97bec4f46dba None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.691882 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.731729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238def43-66ff-44e7-944f-97bec4f46dba None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.764417 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a450c0-a7a5-4454-ab1b-b162ce3b496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.765072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a450c0-a7a5-4454-ab1b-b162ce3b496f None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.765355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a450c0-a7a5-4454-ab1b-b162ce3b496f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.765628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a450c0-a7a5-4454-ab1b-b162ce3b496f None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.766358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a450c0-a7a5-4454-ab1b-b162ce3b496f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.767761 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a450c0-a7a5-4454-ab1b-b162ce3b496f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.858833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 553/1110] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:25:28 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:31.055655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4009c2-6bc7-4592-ac07-ad9ec45a0b86 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.056183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4009c2-6bc7-4592-ac07-ad9ec45a0b86 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.056301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4009c2-6bc7-4592-ac07-ad9ec45a0b86 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.057565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 558/1111] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:31.063237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80614846-a6a6-4096-83d9-76d1e5e207c1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.063647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80614846-a6a6-4096-83d9-76d1e5e207c1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.063889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80614846-a6a6-4096-83d9-76d1e5e207c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.080493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-80614846-a6a6-4096-83d9-76d1e5e207c1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:31.081713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-80614846-a6a6-4096-83d9-76d1e5e207c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:31.146553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 554/1112] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:31.169935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4009c2-6bc7-4592-ac07-ad9ec45a0b86 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.215968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.268243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4009c2-6bc7-4592-ac07-ad9ec45a0b86 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.302252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f82a76-cac1-4ab0-8367-9fa2d481d8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.303087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f82a76-cac1-4ab0-8367-9fa2d481d8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.303372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f82a76-cac1-4ab0-8367-9fa2d481d8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.303649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f82a76-cac1-4ab0-8367-9fa2d481d8a3 None admin] PATH_INFO: `/v3/roles/af99020fdd8b4a4e93e3b913d49e9cf8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.305097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f82a76-cac1-4ab0-8367-9fa2d481d8a3 None admin] RBAC: Authorizing `identity:get_role(role_id=af99020fdd8b4a4e93e3b913d49e9cf8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.306538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f82a76-cac1-4ab0-8367-9fa2d481d8a3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.307821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 559/1113] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/roles/af99020fdd8b4a4e93e3b913d49e9cf8 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:31.313601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80614846-a6a6-4096-83d9-76d1e5e207c1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.357945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.410183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80614846-a6a6-4096-83d9-76d1e5e207c1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.443866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72d5dc-f5a9-4fde-87bb-14bfe66290fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.444723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72d5dc-f5a9-4fde-87bb-14bfe66290fb None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.445008 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72d5dc-f5a9-4fde-87bb-14bfe66290fb None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.445289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72d5dc-f5a9-4fde-87bb-14bfe66290fb None admin] PATH_INFO: `/v3/users/a93d0a48aa5c48e18a4fa5f87980d4f6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.457603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72d5dc-f5a9-4fde-87bb-14bfe66290fb None admin] RBAC: Authorizing `identity:get_user(user_id=a93d0a48aa5c48e18a4fa5f87980d4f6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.459142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72d5dc-f5a9-4fde-87bb-14bfe66290fb None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.460759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 555/1114] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/users/a93d0a48aa5c48e18a4fa5f87980d4f6 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:31.466922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f82a76-cac1-4ab0-8367-9fa2d481d8a3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.561909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f82a76-cac1-4ab0-8367-9fa2d481d8a3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.575159 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.595894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cc91e-69e5-4fd9-881a-5cee88c3f6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.596531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cc91e-69e5-4fd9-881a-5cee88c3f6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.596813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cc91e-69e5-4fd9-881a-5cee88c3f6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.597267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cc91e-69e5-4fd9-881a-5cee88c3f6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.661861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cc91e-69e5-4fd9-881a-5cee88c3f6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.663306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6cc91e-69e5-4fd9-881a-5cee88c3f6e5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.758375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 560/1115] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:31.764930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72d5dc-f5a9-4fde-87bb-14bfe66290fb None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.861672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72d5dc-f5a9-4fde-87bb-14bfe66290fb None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.863210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.895386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27ef17-e6eb-433f-8820-fbc84d3bf371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.896220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27ef17-e6eb-433f-8820-fbc84d3bf371 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.896512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27ef17-e6eb-433f-8820-fbc84d3bf371 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.896795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27ef17-e6eb-433f-8820-fbc84d3bf371 None admin] PATH_INFO: `/v3/projects/d06aeec5c0e048e39488d97549aa86f6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.897988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27ef17-e6eb-433f-8820-fbc84d3bf371 None admin] RBAC: Authorizing `identity:get_project(project_id=d06aeec5c0e048e39488d97549aa86f6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.899403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a27ef17-e6eb-433f-8820-fbc84d3bf371 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.901077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 556/1116] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/projects/d06aeec5c0e048e39488d97549aa86f6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:31.907598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cc91e-69e5-4fd9-881a-5cee88c3f6e5 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.921968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:32.003371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cc91e-69e5-4fd9-881a-5cee88c3f6e5 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.036013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb43365-f0a5-4d23-b79e-a495355f4e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.036649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb43365-f0a5-4d23-b79e-a495355f4e52 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.036934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb43365-f0a5-4d23-b79e-a495355f4e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.037209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb43365-f0a5-4d23-b79e-a495355f4e52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.038056 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb43365-f0a5-4d23-b79e-a495355f4e52 None admin] RBAC: Adding query filter params (role.id=af99020fdd8b4a4e93e3b913d49e9cf8, scope.project.id=d06aeec5c0e048e39488d97549aa86f6, user.id=a93d0a48aa5c48e18a4fa5f87980d4f6) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:32.038368 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb43365-f0a5-4d23-b79e-a495355f4e52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.039774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb43365-f0a5-4d23-b79e-a495355f4e52 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.045019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 561/1117] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/role_assignments?user.id=a93d0a48aa5c48e18a4fa5f87980d4f6&scope.project.id=d06aeec5c0e048e39488d97549aa86f6&role.id=af99020fdd8b4a4e93e3b913d49e9cf8 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:34.163302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432492f-28a1-4d72-999f-9afb431a53bb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.163783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432492f-28a1-4d72-999f-9afb431a53bb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.163867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432492f-28a1-4d72-999f-9afb431a53bb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.165240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 557/1118] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:34.170458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f29bd-34aa-4599-a562-a7dfe14acbc4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.170862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f29bd-34aa-4599-a562-a7dfe14acbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.171020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847f29bd-34aa-4599-a562-a7dfe14acbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.187414 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-847f29bd-34aa-4599-a562-a7dfe14acbc4 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:34.188574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-847f29bd-34aa-4599-a562-a7dfe14acbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:34.252563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 562/1119] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:34.274181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432492f-28a1-4d72-999f-9afb431a53bb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.372467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432492f-28a1-4d72-999f-9afb431a53bb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.404263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d155a3-ca1c-46e4-abea-91d4e474c9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.405095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d155a3-ca1c-46e4-abea-91d4e474c9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.405377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d155a3-ca1c-46e4-abea-91d4e474c9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.405651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d155a3-ca1c-46e4-abea-91d4e474c9d4 None admin] PATH_INFO: `/v3/roles/af99020fdd8b4a4e93e3b913d49e9cf8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.407130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d155a3-ca1c-46e4-abea-91d4e474c9d4 None admin] RBAC: Authorizing `identity:get_role(role_id=af99020fdd8b4a4e93e3b913d49e9cf8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.408479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d155a3-ca1c-46e4-abea-91d4e474c9d4 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.409848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 558/1120] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/roles/af99020fdd8b4a4e93e3b913d49e9cf8 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:34.415364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f29bd-34aa-4599-a562-a7dfe14acbc4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.425737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:34.508965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847f29bd-34aa-4599-a562-a7dfe14acbc4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.540958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fcaa7-d971-4de0-bd82-1f1afa941a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.541837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcaa7-d971-4de0-bd82-1f1afa941a22 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.542122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcaa7-d971-4de0-bd82-1f1afa941a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.542393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcaa7-d971-4de0-bd82-1f1afa941a22 None admin] PATH_INFO: `/v3/users/a93d0a48aa5c48e18a4fa5f87980d4f6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.543555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fcaa7-d971-4de0-bd82-1f1afa941a22 None admin] RBAC: Authorizing `identity:get_user(user_id=a93d0a48aa5c48e18a4fa5f87980d4f6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.545523 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fcaa7-d971-4de0-bd82-1f1afa941a22 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.547125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 563/1121] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/users/a93d0a48aa5c48e18a4fa5f87980d4f6 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:34.552644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d155a3-ca1c-46e4-abea-91d4e474c9d4 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.592194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:34.650081 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d155a3-ca1c-46e4-abea-91d4e474c9d4 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.681980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f1602-2f6b-4f54-b730-4ace9baeaf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.682821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f1602-2f6b-4f54-b730-4ace9baeaf03 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.683107 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f1602-2f6b-4f54-b730-4ace9baeaf03 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.683392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f1602-2f6b-4f54-b730-4ace9baeaf03 None admin] PATH_INFO: `/v3/projects/d06aeec5c0e048e39488d97549aa86f6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.684540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f1602-2f6b-4f54-b730-4ace9baeaf03 None admin] RBAC: Authorizing `identity:get_project(project_id=d06aeec5c0e048e39488d97549aa86f6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.686588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f1602-2f6b-4f54-b730-4ace9baeaf03 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.688252 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 559/1122] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/projects/d06aeec5c0e048e39488d97549aa86f6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:34.694079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fcaa7-d971-4de0-bd82-1f1afa941a22 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.769553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:34.790886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fcaa7-d971-4de0-bd82-1f1afa941a22 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.824249 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6625d2-281e-4b7f-8ecb-151db1b6488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.825130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6625d2-281e-4b7f-8ecb-151db1b6488c None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.825416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6625d2-281e-4b7f-8ecb-151db1b6488c None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.825718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6625d2-281e-4b7f-8ecb-151db1b6488c None admin] PATH_INFO: `/v3/projects/d06aeec5c0e048e39488d97549aa86f6/users/a93d0a48aa5c48e18a4fa5f87980d4f6/roles/af99020fdd8b4a4e93e3b913d49e9cf8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.827886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6625d2-281e-4b7f-8ecb-151db1b6488c None admin] RBAC: Authorizing `identity:create_grant(project_id=d06aeec5c0e048e39488d97549aa86f6, user_id=a93d0a48aa5c48e18a4fa5f87980d4f6, role_id=af99020fdd8b4a4e93e3b913d49e9cf8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.829313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6625d2-281e-4b7f-8ecb-151db1b6488c None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.939106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 564/1123] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:25:34 2022] PUT /identity/v3/projects/d06aeec5c0e048e39488d97549aa86f6/users/a93d0a48aa5c48e18a4fa5f87980d4f6/roles/af99020fdd8b4a4e93e3b913d49e9cf8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:37.079819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfb718-f66d-403a-b27b-7f3e7f217bd9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.080204 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfb718-f66d-403a-b27b-7f3e7f217bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.080293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cfb718-f66d-403a-b27b-7f3e7f217bd9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.081648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 560/1124] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:37.086940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fe21a-3a31-4d56-9897-61be18e74aa2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.087326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fe21a-3a31-4d56-9897-61be18e74aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.087503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909fe21a-3a31-4d56-9897-61be18e74aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.104232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-909fe21a-3a31-4d56-9897-61be18e74aa2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:37.105402 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-909fe21a-3a31-4d56-9897-61be18e74aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:37.169337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 565/1125] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:37.191867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfb718-f66d-403a-b27b-7f3e7f217bd9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.289536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cfb718-f66d-403a-b27b-7f3e7f217bd9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.296226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.322222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4479d-a7e5-4d8d-915c-023ea531978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.323052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4479d-a7e5-4d8d-915c-023ea531978d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.323332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4479d-a7e5-4d8d-915c-023ea531978d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.323606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e4479d-a7e5-4d8d-915c-023ea531978d None admin] PATH_INFO: `/v3/roles/af99020fdd8b4a4e93e3b913d49e9cf8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.325036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4479d-a7e5-4d8d-915c-023ea531978d None admin] RBAC: Authorizing `identity:get_role(role_id=af99020fdd8b4a4e93e3b913d49e9cf8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.327008 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e4479d-a7e5-4d8d-915c-023ea531978d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.328917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 561/1126] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/roles/af99020fdd8b4a4e93e3b913d49e9cf8 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:37.334333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fe21a-3a31-4d56-9897-61be18e74aa2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.396998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.429408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909fe21a-3a31-4d56-9897-61be18e74aa2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.462795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac6973-0b30-4899-9753-582c4afba630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.463652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6973-0b30-4899-9753-582c4afba630 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.463938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6973-0b30-4899-9753-582c4afba630 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.464216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac6973-0b30-4899-9753-582c4afba630 None admin] PATH_INFO: `/v3/users/a93d0a48aa5c48e18a4fa5f87980d4f6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.465381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac6973-0b30-4899-9753-582c4afba630 None admin] RBAC: Authorizing `identity:get_user(user_id=a93d0a48aa5c48e18a4fa5f87980d4f6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.466849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac6973-0b30-4899-9753-582c4afba630 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.468440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 566/1127] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/users/a93d0a48aa5c48e18a4fa5f87980d4f6 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:37.474169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4479d-a7e5-4d8d-915c-023ea531978d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.568873 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e4479d-a7e5-4d8d-915c-023ea531978d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.600991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551fb0e-ccf5-4570-b9ff-0985d4ff5454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.601555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551fb0e-ccf5-4570-b9ff-0985d4ff5454 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.601868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551fb0e-ccf5-4570-b9ff-0985d4ff5454 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.602144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3551fb0e-ccf5-4570-b9ff-0985d4ff5454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.653624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.677919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551fb0e-ccf5-4570-b9ff-0985d4ff5454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.679362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3551fb0e-ccf5-4570-b9ff-0985d4ff5454 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.773075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 562/1128] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:37.778922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac6973-0b30-4899-9753-582c4afba630 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.874473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac6973-0b30-4899-9753-582c4afba630 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.907422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3d0e2-fd8f-4f56-94ee-e883f084ff95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.908256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3d0e2-fd8f-4f56-94ee-e883f084ff95 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.908541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3d0e2-fd8f-4f56-94ee-e883f084ff95 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.908823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3d0e2-fd8f-4f56-94ee-e883f084ff95 None admin] PATH_INFO: `/v3/projects/d06aeec5c0e048e39488d97549aa86f6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.910010 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3d0e2-fd8f-4f56-94ee-e883f084ff95 None admin] RBAC: Authorizing `identity:get_project(project_id=d06aeec5c0e048e39488d97549aa86f6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.911440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3d0e2-fd8f-4f56-94ee-e883f084ff95 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.913082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 567/1129] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/projects/d06aeec5c0e048e39488d97549aa86f6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:37.918995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551fb0e-ccf5-4570-b9ff-0985d4ff5454 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.989072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:38.012622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3551fb0e-ccf5-4570-b9ff-0985d4ff5454 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.045452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeda16b-1ffb-44ab-ad44-0614d9d0122a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.046122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeda16b-1ffb-44ab-ad44-0614d9d0122a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.046403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeda16b-1ffb-44ab-ad44-0614d9d0122a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.046679 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeda16b-1ffb-44ab-ad44-0614d9d0122a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.047491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeda16b-1ffb-44ab-ad44-0614d9d0122a None admin] RBAC: Adding query filter params (role.id=af99020fdd8b4a4e93e3b913d49e9cf8, scope.project.id=d06aeec5c0e048e39488d97549aa86f6, user.id=a93d0a48aa5c48e18a4fa5f87980d4f6) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:38.047799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeda16b-1ffb-44ab-ad44-0614d9d0122a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.049202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeda16b-1ffb-44ab-ad44-0614d9d0122a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.054848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 563/1130] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/role_assignments?user.id=a93d0a48aa5c48e18a4fa5f87980d4f6&scope.project.id=d06aeec5c0e048e39488d97549aa86f6&role.id=af99020fdd8b4a4e93e3b913d49e9cf8 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:40.217829 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31fd2-b7b3-4179-8217-1008362a0f89 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.218339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31fd2-b7b3-4179-8217-1008362a0f89 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.218428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe31fd2-b7b3-4179-8217-1008362a0f89 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.219742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 568/1131] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:40.224856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644268aa-a058-428a-94b5-9f23bd1f5389 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.225289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644268aa-a058-428a-94b5-9f23bd1f5389 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.225413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644268aa-a058-428a-94b5-9f23bd1f5389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.241794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-644268aa-a058-428a-94b5-9f23bd1f5389 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:40.242963 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-644268aa-a058-428a-94b5-9f23bd1f5389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:40.307012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 564/1132] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:40.330480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31fd2-b7b3-4179-8217-1008362a0f89 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.333284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.428664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe31fd2-b7b3-4179-8217-1008362a0f89 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.460384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0be56-3612-4fb7-8806-da95a51b8915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.461159 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0be56-3612-4fb7-8806-da95a51b8915 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.461446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0be56-3612-4fb7-8806-da95a51b8915 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.461751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0be56-3612-4fb7-8806-da95a51b8915 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.462910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0be56-3612-4fb7-8806-da95a51b8915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.464346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0be56-3612-4fb7-8806-da95a51b8915 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.466459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 569/1133] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:40.472085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644268aa-a058-428a-94b5-9f23bd1f5389 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.535165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.567051 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644268aa-a058-428a-94b5-9f23bd1f5389 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.599467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c502fea-e75a-4178-8444-4ca7ea9fa1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.600050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c502fea-e75a-4178-8444-4ca7ea9fa1e9 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.600334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c502fea-e75a-4178-8444-4ca7ea9fa1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.600613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c502fea-e75a-4178-8444-4ca7ea9fa1e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.601300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c502fea-e75a-4178-8444-4ca7ea9fa1e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.602732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c502fea-e75a-4178-8444-4ca7ea9fa1e9 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.682278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 565/1134] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:25:40 2022] POST /identity/v3/projects => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:42.888757 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1f8f-904c-452a-8dde-293d11c5779f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.889306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1f8f-904c-452a-8dde-293d11c5779f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.889306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08be1f8f-904c-452a-8dde-293d11c5779f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.890670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 570/1135] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:42.895812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267416fb-575e-45bf-9754-007d3635074c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.896206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267416fb-575e-45bf-9754-007d3635074c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.896375 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267416fb-575e-45bf-9754-007d3635074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.913458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-267416fb-575e-45bf-9754-007d3635074c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:42.914664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-267416fb-575e-45bf-9754-007d3635074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:42.982149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 566/1136] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:43.006707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be1f8f-904c-452a-8dde-293d11c5779f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:43.074083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:43.105050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08be1f8f-904c-452a-8dde-293d11c5779f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:43.139792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d6514-e3c7-4734-a3f2-94bdbea0bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:43.140512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6514-e3c7-4734-a3f2-94bdbea0bf78 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:43.140800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6514-e3c7-4734-a3f2-94bdbea0bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:43.141145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d6514-e3c7-4734-a3f2-94bdbea0bf78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:43.142341 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d6514-e3c7-4734-a3f2-94bdbea0bf78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:43.143779 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d6514-e3c7-4734-a3f2-94bdbea0bf78 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:43.145381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 571/1137] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:25:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:43.151066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267416fb-575e-45bf-9754-007d3635074c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:43.199565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:43.248478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267416fb-575e-45bf-9754-007d3635074c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:43.283221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ea957d-2b7f-45f6-af9e-b16b241b6407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:43.283881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea957d-2b7f-45f6-af9e-b16b241b6407 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:43.284169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea957d-2b7f-45f6-af9e-b16b241b6407 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:43.284449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ea957d-2b7f-45f6-af9e-b16b241b6407 None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:43.285158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea957d-2b7f-45f6-af9e-b16b241b6407 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:43.286618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ea957d-2b7f-45f6-af9e-b16b241b6407 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:43.395956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 567/1138] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:25:43 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:45.596022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdaada-e048-41a0-bb15-59b302eda7a8 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.596580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdaada-e048-41a0-bb15-59b302eda7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.596580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdaada-e048-41a0-bb15-59b302eda7a8 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.597957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 572/1139] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:45.603176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e9ebb-9836-490a-ae5c-99f15496694f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.603592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e9ebb-9836-490a-ae5c-99f15496694f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.603733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e9ebb-9836-490a-ae5c-99f15496694f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.620281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-af4e9ebb-9836-490a-ae5c-99f15496694f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:45.621475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-af4e9ebb-9836-490a-ae5c-99f15496694f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:45.685638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 568/1140] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:45.709283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdaada-e048-41a0-bb15-59b302eda7a8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.810905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdaada-e048-41a0-bb15-59b302eda7a8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.843398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e975d-97ca-44f9-a6c6-910a4d143961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.844178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e975d-97ca-44f9-a6c6-910a4d143961 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.844467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e975d-97ca-44f9-a6c6-910a4d143961 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.844748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e975d-97ca-44f9-a6c6-910a4d143961 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.851590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.855298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e975d-97ca-44f9-a6c6-910a4d143961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c11e975d-97ca-44f9-a6c6-910a4d143961 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:45.863844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:45.875459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:45.876473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 573/1141] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:45.877371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e9ebb-9836-490a-ae5c-99f15496694f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.905464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.968115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e9ebb-9836-490a-ae5c-99f15496694f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.000857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99905cd-6a27-4ee5-ac0a-a7c138567962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.001518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99905cd-6a27-4ee5-ac0a-a7c138567962 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.001838 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99905cd-6a27-4ee5-ac0a-a7c138567962 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.002122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99905cd-6a27-4ee5-ac0a-a7c138567962 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.002866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99905cd-6a27-4ee5-ac0a-a7c138567962 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:46.003178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99905cd-6a27-4ee5-ac0a-a7c138567962 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.004553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99905cd-6a27-4ee5-ac0a-a7c138567962 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.012399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 569/1142] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:46.018689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e975d-97ca-44f9-a6c6-910a4d143961 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:46.117806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e975d-97ca-44f9-a6c6-910a4d143961 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.150483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e629c17-f0c4-4928-b9e3-6ca53b734162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.151337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e629c17-f0c4-4928-b9e3-6ca53b734162 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.151629 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e629c17-f0c4-4928-b9e3-6ca53b734162 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.151908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e629c17-f0c4-4928-b9e3-6ca53b734162 None admin] PATH_INFO: `/v3/users/0064619fc1554776bd4aab0970afffc7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.165196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e629c17-f0c4-4928-b9e3-6ca53b734162 None admin] RBAC: Authorizing `identity:get_user(user_id=0064619fc1554776bd4aab0970afffc7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.166669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e629c17-f0c4-4928-b9e3-6ca53b734162 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.168292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 574/1143] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:46 2022] GET /identity/v3/users/0064619fc1554776bd4aab0970afffc7 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:46.173955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99905cd-6a27-4ee5-ac0a-a7c138567962 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:46.266473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:46.270082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99905cd-6a27-4ee5-ac0a-a7c138567962 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.301053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6628b8f-058c-45e5-b751-3aeb8db45447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.301703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628b8f-058c-45e5-b751-3aeb8db45447 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.301992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628b8f-058c-45e5-b751-3aeb8db45447 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.302269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6628b8f-058c-45e5-b751-3aeb8db45447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.367086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6628b8f-058c-45e5-b751-3aeb8db45447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.368804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6628b8f-058c-45e5-b751-3aeb8db45447 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.457465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:46.461755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 570/1144] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:46.468094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e629c17-f0c4-4928-b9e3-6ca53b734162 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:46.522249 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:46.563655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e629c17-f0c4-4928-b9e3-6ca53b734162 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.595878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca109df2-9e0f-4d7e-a0a4-c26a999e1af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.596719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca109df2-9e0f-4d7e-a0a4-c26a999e1af8 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.597273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca109df2-9e0f-4d7e-a0a4-c26a999e1af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.597273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca109df2-9e0f-4d7e-a0a4-c26a999e1af8 None admin] PATH_INFO: `/v3/projects/71a913ad02084ec2b61a028ce27d90e6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.598438 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca109df2-9e0f-4d7e-a0a4-c26a999e1af8 None admin] RBAC: Authorizing `identity:get_project(project_id=71a913ad02084ec2b61a028ce27d90e6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.599859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca109df2-9e0f-4d7e-a0a4-c26a999e1af8 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.601510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 575/1145] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:25:46 2022] GET /identity/v3/projects/71a913ad02084ec2b61a028ce27d90e6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:46.607883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6628b8f-058c-45e5-b751-3aeb8db45447 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:46.702256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6628b8f-058c-45e5-b751-3aeb8db45447 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.734768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996bb143-74ac-4641-b3b7-3e9c2939e92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.735394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bb143-74ac-4641-b3b7-3e9c2939e92b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.735678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bb143-74ac-4641-b3b7-3e9c2939e92b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.735954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996bb143-74ac-4641-b3b7-3e9c2939e92b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.736764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bb143-74ac-4641-b3b7-3e9c2939e92b None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=71a913ad02084ec2b61a028ce27d90e6, user.id=0064619fc1554776bd4aab0970afffc7) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:46.737075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bb143-74ac-4641-b3b7-3e9c2939e92b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.738524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996bb143-74ac-4641-b3b7-3e9c2939e92b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.743997 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 571/1146] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:25:46 2022] GET /identity/v3/role_assignments?user.id=0064619fc1554776bd4aab0970afffc7&scope.project.id=71a913ad02084ec2b61a028ce27d90e6&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:48.898361 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aa7e4-7394-41c3-98a8-410e6c80afb8 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.898940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aa7e4-7394-41c3-98a8-410e6c80afb8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.898940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aa7e4-7394-41c3-98a8-410e6c80afb8 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.900283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 576/1147] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:48.906100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6629-aa1e-465b-9dcb-01b389ec7e9d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.906482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6629-aa1e-465b-9dcb-01b389ec7e9d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.906744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da6629-aa1e-465b-9dcb-01b389ec7e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.923780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-71da6629-aa1e-465b-9dcb-01b389ec7e9d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:48.924960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-71da6629-aa1e-465b-9dcb-01b389ec7e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:48.979444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:48.989411 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 572/1148] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:49.011640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8aa7e4-7394-41c3-98a8-410e6c80afb8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.111694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8aa7e4-7394-41c3-98a8-410e6c80afb8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.134341 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.144932 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b24afd-0f52-41ad-b8fa-cfa2a1ef0fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.145770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b24afd-0f52-41ad-b8fa-cfa2a1ef0fdc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.146063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b24afd-0f52-41ad-b8fa-cfa2a1ef0fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.146345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b24afd-0f52-41ad-b8fa-cfa2a1ef0fdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.156626 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b24afd-0f52-41ad-b8fa-cfa2a1ef0fdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-72b24afd-0f52-41ad-b8fa-cfa2a1ef0fdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:49.164124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:49.165265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:49.166271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 577/1149] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:49.171341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da6629-aa1e-465b-9dcb-01b389ec7e9d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.267135 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da6629-aa1e-465b-9dcb-01b389ec7e9d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.299489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8b356-ff78-4de5-a6b1-9cf4ef09be0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.300138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8b356-ff78-4de5-a6b1-9cf4ef09be0d None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.300423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8b356-ff78-4de5-a6b1-9cf4ef09be0d None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.300701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8b356-ff78-4de5-a6b1-9cf4ef09be0d None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.301436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8b356-ff78-4de5-a6b1-9cf4ef09be0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:49.301771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8b356-ff78-4de5-a6b1-9cf4ef09be0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.303126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8b356-ff78-4de5-a6b1-9cf4ef09be0d None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.311372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 573/1150] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:49.317091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b24afd-0f52-41ad-b8fa-cfa2a1ef0fdc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.414117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b24afd-0f52-41ad-b8fa-cfa2a1ef0fdc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.446468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f51a9-c0da-49de-8141-0e197150249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.447326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f51a9-c0da-49de-8141-0e197150249f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.447613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f51a9-c0da-49de-8141-0e197150249f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.447893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f51a9-c0da-49de-8141-0e197150249f None admin] PATH_INFO: `/v3/users/0064619fc1554776bd4aab0970afffc7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.449065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f51a9-c0da-49de-8141-0e197150249f None admin] RBAC: Authorizing `identity:get_user(user_id=0064619fc1554776bd4aab0970afffc7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.451097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f51a9-c0da-49de-8141-0e197150249f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.452701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 578/1151] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:49 2022] GET /identity/v3/users/0064619fc1554776bd4aab0970afffc7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:49.458463 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8b356-ff78-4de5-a6b1-9cf4ef09be0d None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.513640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.556368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8b356-ff78-4de5-a6b1-9cf4ef09be0d None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.588535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d5913-d6d2-435d-8c8f-bdfb63f4a0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.589382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d5913-d6d2-435d-8c8f-bdfb63f4a0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.589704 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d5913-d6d2-435d-8c8f-bdfb63f4a0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.589985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d5913-d6d2-435d-8c8f-bdfb63f4a0f0 None admin] PATH_INFO: `/v3/projects/71a913ad02084ec2b61a028ce27d90e6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.591857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d5913-d6d2-435d-8c8f-bdfb63f4a0f0 None admin] RBAC: Authorizing `identity:get_project(project_id=71a913ad02084ec2b61a028ce27d90e6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.593273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d5913-d6d2-435d-8c8f-bdfb63f4a0f0 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.594988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 574/1152] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:25:49 2022] GET /identity/v3/projects/71a913ad02084ec2b61a028ce27d90e6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:49.600734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f51a9-c0da-49de-8141-0e197150249f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.652444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.698269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f51a9-c0da-49de-8141-0e197150249f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.732674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3956f1-fba8-41ca-8b63-2a451788961f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.733547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3956f1-fba8-41ca-8b63-2a451788961f None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.733864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3956f1-fba8-41ca-8b63-2a451788961f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.734148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3956f1-fba8-41ca-8b63-2a451788961f None admin] PATH_INFO: `/v3/projects/71a913ad02084ec2b61a028ce27d90e6/users/0064619fc1554776bd4aab0970afffc7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.736081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3956f1-fba8-41ca-8b63-2a451788961f None admin] RBAC: Authorizing `identity:create_grant(project_id=71a913ad02084ec2b61a028ce27d90e6, user_id=0064619fc1554776bd4aab0970afffc7, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.737511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3956f1-fba8-41ca-8b63-2a451788961f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.876926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 579/1153] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:25:49 2022] PUT /identity/v3/projects/71a913ad02084ec2b61a028ce27d90e6/users/0064619fc1554776bd4aab0970afffc7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:52.027623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50c53c-3a5b-4c84-9387-8e5b4b12b6e9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.028726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50c53c-3a5b-4c84-9387-8e5b4b12b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.028726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50c53c-3a5b-4c84-9387-8e5b4b12b6e9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.030132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 575/1154] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:52.035347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc6f9b-b428-40ae-9d00-6d0fbdc1eeda None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.035711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc6f9b-b428-40ae-9d00-6d0fbdc1eeda None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.035907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc6f9b-b428-40ae-9d00-6d0fbdc1eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.052166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ddfc6f9b-b428-40ae-9d00-6d0fbdc1eeda None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:52.053334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ddfc6f9b-b428-40ae-9d00-6d0fbdc1eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:52.117595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 580/1155] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:52.140965 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50c53c-3a5b-4c84-9387-8e5b4b12b6e9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.238131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50c53c-3a5b-4c84-9387-8e5b4b12b6e9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:52.259676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:52.270543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c3de4-6319-49d6-afc6-854f0705b7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:52.271316 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3de4-6319-49d6-afc6-854f0705b7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.271600 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3de4-6319-49d6-afc6-854f0705b7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.272464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3de4-6319-49d6-afc6-854f0705b7e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.282726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c3de4-6319-49d6-afc6-854f0705b7e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-7e4c3de4-6319-49d6-afc6-854f0705b7e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:52.290365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:52.291511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:25:52.292473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 576/1156] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:52.298218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc6f9b-b428-40ae-9d00-6d0fbdc1eeda None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.338958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:52.393207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc6f9b-b428-40ae-9d00-6d0fbdc1eeda None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:52.426549 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a52e8-32f5-4d7a-8836-ea71ff97ab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:52.427201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a52e8-32f5-4d7a-8836-ea71ff97ab9f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.427486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a52e8-32f5-4d7a-8836-ea71ff97ab9f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.427761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397a52e8-32f5-4d7a-8836-ea71ff97ab9f None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.428499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a52e8-32f5-4d7a-8836-ea71ff97ab9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:52.428805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a52e8-32f5-4d7a-8836-ea71ff97ab9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:52.430203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397a52e8-32f5-4d7a-8836-ea71ff97ab9f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:52.438166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 581/1157] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:52.443916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c3de4-6319-49d6-afc6-854f0705b7e0 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.540855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c3de4-6319-49d6-afc6-854f0705b7e0 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:52.573797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6a6fe-984f-4bb2-833f-ff05712fe0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:52.574647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6a6fe-984f-4bb2-833f-ff05712fe0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.574960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6a6fe-984f-4bb2-833f-ff05712fe0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.575244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6a6fe-984f-4bb2-833f-ff05712fe0d1 None admin] PATH_INFO: `/v3/users/0064619fc1554776bd4aab0970afffc7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.576410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6a6fe-984f-4bb2-833f-ff05712fe0d1 None admin] RBAC: Authorizing `identity:get_user(user_id=0064619fc1554776bd4aab0970afffc7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:52.577862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6a6fe-984f-4bb2-833f-ff05712fe0d1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:52.579467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 577/1158] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/users/0064619fc1554776bd4aab0970afffc7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:52.585220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a52e8-32f5-4d7a-8836-ea71ff97ab9f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.682273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397a52e8-32f5-4d7a-8836-ea71ff97ab9f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:52.684561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:52.714538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c54f-4971-46aa-ba2a-a5cf98fccb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:52.715215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c54f-4971-46aa-ba2a-a5cf98fccb71 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.715744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c54f-4971-46aa-ba2a-a5cf98fccb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.716199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733c54f-4971-46aa-ba2a-a5cf98fccb71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.782188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733c54f-4971-46aa-ba2a-a5cf98fccb71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:52.783633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733c54f-4971-46aa-ba2a-a5cf98fccb71 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:52.876592 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 582/1159] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:52.882418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6a6fe-984f-4bb2-833f-ff05712fe0d1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.930716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:52.977889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6a6fe-984f-4bb2-833f-ff05712fe0d1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.011077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e3a51-47b7-4155-8cf5-fde5d536e1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.011901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3a51-47b7-4155-8cf5-fde5d536e1da None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.012181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3a51-47b7-4155-8cf5-fde5d536e1da None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.012521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e3a51-47b7-4155-8cf5-fde5d536e1da None admin] PATH_INFO: `/v3/projects/71a913ad02084ec2b61a028ce27d90e6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.013653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e3a51-47b7-4155-8cf5-fde5d536e1da None admin] RBAC: Authorizing `identity:get_project(project_id=71a913ad02084ec2b61a028ce27d90e6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.015093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e3a51-47b7-4155-8cf5-fde5d536e1da None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.016733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 578/1160] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/projects/71a913ad02084ec2b61a028ce27d90e6 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:53.022638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c54f-4971-46aa-ba2a-a5cf98fccb71 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.025625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:53.119303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733c54f-4971-46aa-ba2a-a5cf98fccb71 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.152524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3003f4ae-3d72-452e-bd46-776c721c3117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.153114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f4ae-3d72-452e-bd46-776c721c3117 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.153400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f4ae-3d72-452e-bd46-776c721c3117 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.153691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003f4ae-3d72-452e-bd46-776c721c3117 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.154520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003f4ae-3d72-452e-bd46-776c721c3117 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=71a913ad02084ec2b61a028ce27d90e6, user.id=0064619fc1554776bd4aab0970afffc7) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:53.154838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003f4ae-3d72-452e-bd46-776c721c3117 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.156269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3003f4ae-3d72-452e-bd46-776c721c3117 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.161950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 583/1161] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/role_assignments?user.id=0064619fc1554776bd4aab0970afffc7&scope.project.id=71a913ad02084ec2b61a028ce27d90e6&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:55.319365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66578082-d9f2-43c6-9e03-938a3066cf1f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.319907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66578082-d9f2-43c6-9e03-938a3066cf1f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.319907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66578082-d9f2-43c6-9e03-938a3066cf1f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.321255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 579/1162] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:55.326867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14d0d2-e977-4f93-8279-3dd30a52987d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.327292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14d0d2-e977-4f93-8279-3dd30a52987d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.327431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14d0d2-e977-4f93-8279-3dd30a52987d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.344711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cc14d0d2-e977-4f93-8279-3dd30a52987d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:55.345869 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cc14d0d2-e977-4f93-8279-3dd30a52987d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:55.405556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:55.410988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 584/1163] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:55.432220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66578082-d9f2-43c6-9e03-938a3066cf1f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:55.530510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66578082-d9f2-43c6-9e03-938a3066cf1f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:55.547138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:55.563762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1cc3b-bf27-4b63-b3af-88b323092b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:55.564383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1cc3b-bf27-4b63-b3af-88b323092b07 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.564667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1cc3b-bf27-4b63-b3af-88b323092b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.564943 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1cc3b-bf27-4b63-b3af-88b323092b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.629617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1cc3b-bf27-4b63-b3af-88b323092b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:55.631072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1cc3b-bf27-4b63-b3af-88b323092b07 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:55.724693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 580/1164] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:25:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:55.730642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14d0d2-e977-4f93-8279-3dd30a52987d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:55.829079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14d0d2-e977-4f93-8279-3dd30a52987d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:55.861581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da126a-1a8d-4328-8bb6-e331356b6951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:55.862401 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da126a-1a8d-4328-8bb6-e331356b6951 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.862681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da126a-1a8d-4328-8bb6-e331356b6951 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.862956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da126a-1a8d-4328-8bb6-e331356b6951 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.869748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da126a-1a8d-4328-8bb6-e331356b6951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:55.871180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9da126a-1a8d-4328-8bb6-e331356b6951 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b9da126a-1a8d-4328-8bb6-e331356b6951 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:55.884749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:55.885931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:25:55.887125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 585/1165] 10.222.0.41 () {56 vars in 1117 bytes} [Thu May 26 12:25:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:55.892349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1cc3b-bf27-4b63-b3af-88b323092b07 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:55.910661 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:55.988760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1cc3b-bf27-4b63-b3af-88b323092b07 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:56.022081 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea262f1-74e2-462a-b55c-49a892d40955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:56.022727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea262f1-74e2-462a-b55c-49a892d40955 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.023009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea262f1-74e2-462a-b55c-49a892d40955 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.023286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea262f1-74e2-462a-b55c-49a892d40955 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.023997 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea262f1-74e2-462a-b55c-49a892d40955 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:56.024300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea262f1-74e2-462a-b55c-49a892d40955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:56.025651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea262f1-74e2-462a-b55c-49a892d40955 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:56.032543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 581/1166] 10.222.0.41 () {56 vars in 1115 bytes} [Thu May 26 12:25:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:58.176459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23080c5f-1ef9-40af-ad91-fdb9d3976c09 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.176955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23080c5f-1ef9-40af-ad91-fdb9d3976c09 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.177062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23080c5f-1ef9-40af-ad91-fdb9d3976c09 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.178396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 586/1167] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:58.183758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089f2d0-57ce-4265-88a4-501f4c8376be None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.184132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089f2d0-57ce-4265-88a4-501f4c8376be None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.184368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089f2d0-57ce-4265-88a4-501f4c8376be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.201161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5089f2d0-57ce-4265-88a4-501f4c8376be None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:58.202378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5089f2d0-57ce-4265-88a4-501f4c8376be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:58.267238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 582/1168] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:25:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:58.289216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23080c5f-1ef9-40af-ad91-fdb9d3976c09 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:58.346628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:58.387831 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23080c5f-1ef9-40af-ad91-fdb9d3976c09 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:58.419501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bdcd1-b51d-45e3-80fa-08d65340f7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:58.420142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bdcd1-b51d-45e3-80fa-08d65340f7f1 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.420426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bdcd1-b51d-45e3-80fa-08d65340f7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.420701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bdcd1-b51d-45e3-80fa-08d65340f7f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.421430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bdcd1-b51d-45e3-80fa-08d65340f7f1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:58.422857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bdcd1-b51d-45e3-80fa-08d65340f7f1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:58.510274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 587/1169] 10.222.0.41 () {60 vars in 1138 bytes} [Thu May 26 12:25:58 2022] POST /identity/v3/domains => generated 267 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:00.720864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba96d4b-378a-4b8b-bdbf-15bfb38aa9c2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.721499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba96d4b-378a-4b8b-bdbf-15bfb38aa9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.721499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba96d4b-378a-4b8b-bdbf-15bfb38aa9c2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.722850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 583/1170] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:00.727981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456bb60-7739-4f50-af02-8f87fe75c73d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.728349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456bb60-7739-4f50-af02-8f87fe75c73d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.728551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456bb60-7739-4f50-af02-8f87fe75c73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.745362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e456bb60-7739-4f50-af02-8f87fe75c73d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:00.747091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e456bb60-7739-4f50-af02-8f87fe75c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:00.811612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 588/1171] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:26:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:00.835772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba96d4b-378a-4b8b-bdbf-15bfb38aa9c2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:00.850790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:00.939967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba96d4b-378a-4b8b-bdbf-15bfb38aa9c2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:00.973865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db4db1-33e9-4d51-844a-d87c1da84e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:00.974645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db4db1-33e9-4d51-844a-d87c1da84e6c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.974928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db4db1-33e9-4d51-844a-d87c1da84e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.975205 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db4db1-33e9-4d51-844a-d87c1da84e6c None admin] PATH_INFO: `/v3/domains/efc981647f3346328c5552738f3e22a8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.986581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db4db1-33e9-4d51-844a-d87c1da84e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=efc981647f3346328c5552738f3e22a8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:00.988045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db4db1-33e9-4d51-844a-d87c1da84e6c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:00.989926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 584/1172] 10.222.0.41 () {56 vars in 1183 bytes} [Thu May 26 12:26:00 2022] GET /identity/v3/domains/efc981647f3346328c5552738f3e22a8 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:00.995915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456bb60-7739-4f50-af02-8f87fe75c73d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:01.045229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:01.095591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456bb60-7739-4f50-af02-8f87fe75c73d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:01.128746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c28cc-3d07-4a84-94d6-ad276442109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:01.129405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c28cc-3d07-4a84-94d6-ad276442109e None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.129720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c28cc-3d07-4a84-94d6-ad276442109e None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.130007 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c28cc-3d07-4a84-94d6-ad276442109e None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.130708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c28cc-3d07-4a84-94d6-ad276442109e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:01.132149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c28cc-3d07-4a84-94d6-ad276442109e None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:01.258856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 589/1173] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:26:00 2022] POST /identity/v3/projects => generated 361 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:03.448196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b45a8-fa0e-4c71-9185-041a641cca4d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.448715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b45a8-fa0e-4c71-9185-041a641cca4d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.448818 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b45a8-fa0e-4c71-9185-041a641cca4d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.450663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 585/1174] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:03.455912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e54fe-cc11-4a89-b0bd-e4e8f12a2a70 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.456344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e54fe-cc11-4a89-b0bd-e4e8f12a2a70 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.456471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e54fe-cc11-4a89-b0bd-e4e8f12a2a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.473648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b48e54fe-cc11-4a89-b0bd-e4e8f12a2a70 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:03.474839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b48e54fe-cc11-4a89-b0bd-e4e8f12a2a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:03.538244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 590/1175] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:26:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:03.562613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b45a8-fa0e-4c71-9185-041a641cca4d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:03.632245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:03.662010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b45a8-fa0e-4c71-9185-041a641cca4d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:03.694894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e52443-500b-47e6-a17d-0da398a367e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:03.695735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e52443-500b-47e6-a17d-0da398a367e6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.696026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e52443-500b-47e6-a17d-0da398a367e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.696307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e52443-500b-47e6-a17d-0da398a367e6 None admin] PATH_INFO: `/v3/domains/efc981647f3346328c5552738f3e22a8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.697465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e52443-500b-47e6-a17d-0da398a367e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=efc981647f3346328c5552738f3e22a8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:03.698990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e52443-500b-47e6-a17d-0da398a367e6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:03.701136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 586/1176] 10.222.0.41 () {56 vars in 1183 bytes} [Thu May 26 12:26:03 2022] GET /identity/v3/domains/efc981647f3346328c5552738f3e22a8 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:03.706731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e54fe-cc11-4a89-b0bd-e4e8f12a2a70 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:03.735020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:03.801216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e54fe-cc11-4a89-b0bd-e4e8f12a2a70 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:03.834711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70ad11-98fd-416f-a265-b894b6a96b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:03.835371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70ad11-98fd-416f-a265-b894b6a96b34 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.835656 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70ad11-98fd-416f-a265-b894b6a96b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.835934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70ad11-98fd-416f-a265-b894b6a96b34 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.836628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70ad11-98fd-416f-a265-b894b6a96b34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:03.838096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70ad11-98fd-416f-a265-b894b6a96b34 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:03.956006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 591/1177] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:26:03 2022] POST /identity/v3/users => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:06.191298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819c50-7829-4283-ba7c-77994110f343 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.191803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819c50-7829-4283-ba7c-77994110f343 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.191890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02819c50-7829-4283-ba7c-77994110f343 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.193222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 587/1178] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:06.198522 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921451-fab6-4395-8d0c-1ebbc0ac19ca None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.198910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921451-fab6-4395-8d0c-1ebbc0ac19ca None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.199084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d921451-fab6-4395-8d0c-1ebbc0ac19ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.216703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3d921451-fab6-4395-8d0c-1ebbc0ac19ca None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:06.217937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3d921451-fab6-4395-8d0c-1ebbc0ac19ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:06.281984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 592/1179] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:26:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:06.304368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02819c50-7829-4283-ba7c-77994110f343 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.403043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02819c50-7829-4283-ba7c-77994110f343 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.435118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7aa8-129c-4e92-8228-7f1c941a2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.435888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7aa8-129c-4e92-8228-7f1c941a2e91 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.436167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7aa8-129c-4e92-8228-7f1c941a2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.436438 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f7aa8-129c-4e92-8228-7f1c941a2e91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.443713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:06.447030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f7aa8-129c-4e92-8228-7f1c941a2e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-e84f7aa8-129c-4e92-8228-7f1c941a2e91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:06.455056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:06.458883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:26:06.459926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 588/1180] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:26:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:06.462139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d921451-fab6-4395-8d0c-1ebbc0ac19ca None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.479317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:06.556915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d921451-fab6-4395-8d0c-1ebbc0ac19ca None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.589040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db332e4-0ab5-4f8a-940b-f53c87cdd281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.589709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db332e4-0ab5-4f8a-940b-f53c87cdd281 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.590510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db332e4-0ab5-4f8a-940b-f53c87cdd281 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.590794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db332e4-0ab5-4f8a-940b-f53c87cdd281 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.591530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db332e4-0ab5-4f8a-940b-f53c87cdd281 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:06.591836 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db332e4-0ab5-4f8a-940b-f53c87cdd281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.593200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db332e4-0ab5-4f8a-940b-f53c87cdd281 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:06.601008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 593/1181] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:06.607244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7aa8-129c-4e92-8228-7f1c941a2e91 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.701987 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f7aa8-129c-4e92-8228-7f1c941a2e91 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.734462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085726c-bab0-46fe-b1cd-f3929251047c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.735307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085726c-bab0-46fe-b1cd-f3929251047c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.735589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085726c-bab0-46fe-b1cd-f3929251047c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.735866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085726c-bab0-46fe-b1cd-f3929251047c None admin] PATH_INFO: `/v3/users/e1600a41a77f41f7b82179771261f2b9` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.749344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085726c-bab0-46fe-b1cd-f3929251047c None admin] RBAC: Authorizing `identity:get_user(user_id=e1600a41a77f41f7b82179771261f2b9)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.751276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085726c-bab0-46fe-b1cd-f3929251047c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:06.752549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 589/1182] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:26:06 2022] GET /identity/v3/users/e1600a41a77f41f7b82179771261f2b9 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:06.758175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db332e4-0ab5-4f8a-940b-f53c87cdd281 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.834372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:06.854346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db332e4-0ab5-4f8a-940b-f53c87cdd281 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.887965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1770-a8bd-45c1-a1c4-fb223913121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.888605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1770-a8bd-45c1-a1c4-fb223913121d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.888888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1770-a8bd-45c1-a1c4-fb223913121d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.889164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd1770-a8bd-45c1-a1c4-fb223913121d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.953649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd1770-a8bd-45c1-a1c4-fb223913121d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.955066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd1770-a8bd-45c1-a1c4-fb223913121d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:07.028424 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:07.049458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 594/1183] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:26:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:07.055370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085726c-bab0-46fe-b1cd-f3929251047c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:07.111954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:07.151717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085726c-bab0-46fe-b1cd-f3929251047c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:07.184564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae574d-b75f-49e1-aa4a-24e16035bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:07.185414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae574d-b75f-49e1-aa4a-24e16035bea5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:07.185725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae574d-b75f-49e1-aa4a-24e16035bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:07.186009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae574d-b75f-49e1-aa4a-24e16035bea5 None admin] PATH_INFO: `/v3/projects/329124410bf84157b3e021f2613fa42d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:07.187165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae574d-b75f-49e1-aa4a-24e16035bea5 None admin] RBAC: Authorizing `identity:get_project(project_id=329124410bf84157b3e021f2613fa42d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:07.188584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae574d-b75f-49e1-aa4a-24e16035bea5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:07.190286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 590/1184] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:26:07 2022] GET /identity/v3/projects/329124410bf84157b3e021f2613fa42d => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:07.196292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1770-a8bd-45c1-a1c4-fb223913121d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:07.291458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd1770-a8bd-45c1-a1c4-fb223913121d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:07.324278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb31b5d-8beb-4679-bd9d-29bbb35fabb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:07.324916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb31b5d-8beb-4679-bd9d-29bbb35fabb6 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:07.325198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb31b5d-8beb-4679-bd9d-29bbb35fabb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:07.325476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb31b5d-8beb-4679-bd9d-29bbb35fabb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:07.326319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb31b5d-8beb-4679-bd9d-29bbb35fabb6 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=329124410bf84157b3e021f2613fa42d, user.id=e1600a41a77f41f7b82179771261f2b9) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:07.326629 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb31b5d-8beb-4679-bd9d-29bbb35fabb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:07.328061 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb31b5d-8beb-4679-bd9d-29bbb35fabb6 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:07.333352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 595/1185] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:26:07 2022] GET /identity/v3/role_assignments?user.id=e1600a41a77f41f7b82179771261f2b9&scope.project.id=329124410bf84157b3e021f2613fa42d&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:09.480518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f5ab2-bcec-4f3b-bc98-8e17ff99faaa None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.481067 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f5ab2-bcec-4f3b-bc98-8e17ff99faaa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.481067 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f5ab2-bcec-4f3b-bc98-8e17ff99faaa None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.482461 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 591/1186] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:09.487628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229154d7-0288-4e2d-a7e6-ff93652d3a63 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.488014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229154d7-0288-4e2d-a7e6-ff93652d3a63 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.488186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229154d7-0288-4e2d-a7e6-ff93652d3a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.505101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-229154d7-0288-4e2d-a7e6-ff93652d3a63 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:09.506298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-229154d7-0288-4e2d-a7e6-ff93652d3a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:09.540078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:09.571223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 596/1187] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:26:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:09.593027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f5ab2-bcec-4f3b-bc98-8e17ff99faaa None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.691923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f5ab2-bcec-4f3b-bc98-8e17ff99faaa None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.716681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:09.724715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d4a82-7c8b-4868-a086-d684dbbaca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.725487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4a82-7c8b-4868-a086-d684dbbaca15 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.731939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4a82-7c8b-4868-a086-d684dbbaca15 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.731939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4a82-7c8b-4868-a086-d684dbbaca15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.736176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d4a82-7c8b-4868-a086-d684dbbaca15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c02d4a82-7c8b-4868-a086-d684dbbaca15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:09.743991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:09.744907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:26:09.745787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 592/1188] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:09.751269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229154d7-0288-4e2d-a7e6-ff93652d3a63 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.845137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229154d7-0288-4e2d-a7e6-ff93652d3a63 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.877818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d201889-b7a6-4580-ab97-cbf6d2e67efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.878470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d201889-b7a6-4580-ab97-cbf6d2e67efc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.878758 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d201889-b7a6-4580-ab97-cbf6d2e67efc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.879035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d201889-b7a6-4580-ab97-cbf6d2e67efc None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.879773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d201889-b7a6-4580-ab97-cbf6d2e67efc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:09.880080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d201889-b7a6-4580-ab97-cbf6d2e67efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:09.881434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d201889-b7a6-4580-ab97-cbf6d2e67efc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:09.889890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 597/1189] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:09.896412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d4a82-7c8b-4868-a086-d684dbbaca15 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.992517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d4a82-7c8b-4868-a086-d684dbbaca15 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.024895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae8aa2-89ce-445d-8dd3-7fa2c8713090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.025765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8aa2-89ce-445d-8dd3-7fa2c8713090 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.026055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8aa2-89ce-445d-8dd3-7fa2c8713090 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.026331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ae8aa2-89ce-445d-8dd3-7fa2c8713090 None admin] PATH_INFO: `/v3/users/e1600a41a77f41f7b82179771261f2b9` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.028015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae8aa2-89ce-445d-8dd3-7fa2c8713090 None admin] RBAC: Authorizing `identity:get_user(user_id=e1600a41a77f41f7b82179771261f2b9)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:10.029446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ae8aa2-89ce-445d-8dd3-7fa2c8713090 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:10.031063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 593/1190] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/users/e1600a41a77f41f7b82179771261f2b9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:10.036711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d201889-b7a6-4580-ab97-cbf6d2e67efc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:10.069868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:10.133560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d201889-b7a6-4580-ab97-cbf6d2e67efc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.166684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e2774-f052-4ffc-a8f2-ab7815eee7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.167541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e2774-f052-4ffc-a8f2-ab7815eee7cd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.167830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e2774-f052-4ffc-a8f2-ab7815eee7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.168141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e2774-f052-4ffc-a8f2-ab7815eee7cd None admin] PATH_INFO: `/v3/projects/329124410bf84157b3e021f2613fa42d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.169315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e2774-f052-4ffc-a8f2-ab7815eee7cd None admin] RBAC: Authorizing `identity:get_project(project_id=329124410bf84157b3e021f2613fa42d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:10.170786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e2774-f052-4ffc-a8f2-ab7815eee7cd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:10.172546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 598/1191] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:26:10 2022] GET /identity/v3/projects/329124410bf84157b3e021f2613fa42d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:10.178432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae8aa2-89ce-445d-8dd3-7fa2c8713090 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:10.232598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:10.275133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ae8aa2-89ce-445d-8dd3-7fa2c8713090 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.307013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63702071-7eab-4697-aee5-ac2719557e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.307874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63702071-7eab-4697-aee5-ac2719557e7f None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.308154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63702071-7eab-4697-aee5-ac2719557e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.308426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63702071-7eab-4697-aee5-ac2719557e7f None admin] PATH_INFO: `/v3/projects/329124410bf84157b3e021f2613fa42d/users/e1600a41a77f41f7b82179771261f2b9/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.310960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63702071-7eab-4697-aee5-ac2719557e7f None admin] RBAC: Authorizing `identity:create_grant(project_id=329124410bf84157b3e021f2613fa42d, user_id=e1600a41a77f41f7b82179771261f2b9, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:10.312448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63702071-7eab-4697-aee5-ac2719557e7f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:10.366111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 594/1192] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:26:10 2022] PUT /identity/v3/projects/329124410bf84157b3e021f2613fa42d/users/e1600a41a77f41f7b82179771261f2b9/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:26:12.504316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1ee2-dceb-4630-9f01-85a2bf94dbfe None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.504835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1ee2-dceb-4630-9f01-85a2bf94dbfe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.504923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e1ee2-dceb-4630-9f01-85a2bf94dbfe None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.506269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 599/1193] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:12.511376 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2744be-40d9-4d45-be24-3931f17b34dc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.511757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2744be-40d9-4d45-be24-3931f17b34dc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.511978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2744be-40d9-4d45-be24-3931f17b34dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.528866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9a2744be-40d9-4d45-be24-3931f17b34dc None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:12.530103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9a2744be-40d9-4d45-be24-3931f17b34dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:12.594604 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 595/1194] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:26:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:12.617670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1ee2-dceb-4630-9f01-85a2bf94dbfe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:12.714673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e1ee2-dceb-4630-9f01-85a2bf94dbfe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.716639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:12.748220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a0936-cf81-4fbd-8c74-d7bf7270da3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.749011 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0936-cf81-4fbd-8c74-d7bf7270da3a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.749468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0936-cf81-4fbd-8c74-d7bf7270da3a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.749831 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0936-cf81-4fbd-8c74-d7bf7270da3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.759873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a0936-cf81-4fbd-8c74-d7bf7270da3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5e0a0936-cf81-4fbd-8c74-d7bf7270da3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:12.767239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:12.768304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:26:12.769324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 600/1195] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:26:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:12.774460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2744be-40d9-4d45-be24-3931f17b34dc None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:12.820838 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:12.873003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2744be-40d9-4d45-be24-3931f17b34dc None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.905980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e2d81-3776-45a2-9277-a3b43217d62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.906630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e2d81-3776-45a2-9277-a3b43217d62e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.906914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e2d81-3776-45a2-9277-a3b43217d62e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.907190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1e2d81-3776-45a2-9277-a3b43217d62e None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.907922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e2d81-3776-45a2-9277-a3b43217d62e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:12.908224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e2d81-3776-45a2-9277-a3b43217d62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:12.909574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1e2d81-3776-45a2-9277-a3b43217d62e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:12.917423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 596/1196] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:12.923480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a0936-cf81-4fbd-8c74-d7bf7270da3a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.019257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a0936-cf81-4fbd-8c74-d7bf7270da3a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.051474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047db720-fb82-4e0b-af41-5aed9f3f7e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.052321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047db720-fb82-4e0b-af41-5aed9f3f7e1d None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.052605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047db720-fb82-4e0b-af41-5aed9f3f7e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.052881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047db720-fb82-4e0b-af41-5aed9f3f7e1d None admin] PATH_INFO: `/v3/users/e1600a41a77f41f7b82179771261f2b9` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.054057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047db720-fb82-4e0b-af41-5aed9f3f7e1d None admin] RBAC: Authorizing `identity:get_user(user_id=e1600a41a77f41f7b82179771261f2b9)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.055474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047db720-fb82-4e0b-af41-5aed9f3f7e1d None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.057039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 601/1197] 10.222.0.41 () {56 vars in 1177 bytes} [Thu May 26 12:26:12 2022] GET /identity/v3/users/e1600a41a77f41f7b82179771261f2b9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:13.062588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e2d81-3776-45a2-9277-a3b43217d62e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.161477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1e2d81-3776-45a2-9277-a3b43217d62e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.168266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.195401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea84e8-360b-4cc7-a418-3011e2bddd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.196039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea84e8-360b-4cc7-a418-3011e2bddd7e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.196327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea84e8-360b-4cc7-a418-3011e2bddd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.196609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea84e8-360b-4cc7-a418-3011e2bddd7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.262471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea84e8-360b-4cc7-a418-3011e2bddd7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.263904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea84e8-360b-4cc7-a418-3011e2bddd7e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.357393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 597/1198] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:13.363272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047db720-fb82-4e0b-af41-5aed9f3f7e1d None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.394906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.460045 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047db720-fb82-4e0b-af41-5aed9f3f7e1d None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.492648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a958158-d103-4f31-a3bf-373a14314475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.493817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958158-d103-4f31-a3bf-373a14314475 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.494106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958158-d103-4f31-a3bf-373a14314475 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.494380 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a958158-d103-4f31-a3bf-373a14314475 None admin] PATH_INFO: `/v3/projects/329124410bf84157b3e021f2613fa42d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.495528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a958158-d103-4f31-a3bf-373a14314475 None admin] RBAC: Authorizing `identity:get_project(project_id=329124410bf84157b3e021f2613fa42d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.497465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a958158-d103-4f31-a3bf-373a14314475 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.499163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 602/1199] 10.222.0.41 () {56 vars in 1186 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/projects/329124410bf84157b3e021f2613fa42d => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:13.505394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea84e8-360b-4cc7-a418-3011e2bddd7e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.513899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.603247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea84e8-360b-4cc7-a418-3011e2bddd7e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.635808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8aea95-42ec-492d-939e-091e4c2921a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.636398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aea95-42ec-492d-939e-091e4c2921a7 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.637200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aea95-42ec-492d-939e-091e4c2921a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.637485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8aea95-42ec-492d-939e-091e4c2921a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.638344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aea95-42ec-492d-939e-091e4c2921a7 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=329124410bf84157b3e021f2613fa42d, user.id=e1600a41a77f41f7b82179771261f2b9) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:13.638662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aea95-42ec-492d-939e-091e4c2921a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.640175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8aea95-42ec-492d-939e-091e4c2921a7 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.645884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 598/1200] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/role_assignments?user.id=e1600a41a77f41f7b82179771261f2b9&scope.project.id=329124410bf84157b3e021f2613fa42d&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:23.488706 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=51 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:23.643266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=65 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:29.927283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f172b-2841-4b0d-9a04-c6e54621c967 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:29.927886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f172b-2841-4b0d-9a04-c6e54621c967 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:29.927886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f172b-2841-4b0d-9a04-c6e54621c967 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:29.929202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 603/1201] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:29.935143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51084-70ed-4940-9193-39817f9fe538 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:29.935580 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51084-70ed-4940-9193-39817f9fe538 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:29.935760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e51084-70ed-4940-9193-39817f9fe538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:29.952528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-17e51084-70ed-4940-9193-39817f9fe538 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:29.954272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-17e51084-70ed-4940-9193-39817f9fe538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:30.019091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 599/1202] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:27:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:30.043387 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f172b-2841-4b0d-9a04-c6e54621c967 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:30.145111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f172b-2841-4b0d-9a04-c6e54621c967 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:30.178641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a84ac-ba7c-45a5-ad2c-4dba404c4202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:30.179358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a84ac-ba7c-45a5-ad2c-4dba404c4202 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:30.179640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a84ac-ba7c-45a5-ad2c-4dba404c4202 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:30.179914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a84ac-ba7c-45a5-ad2c-4dba404c4202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:30.190226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a84ac-ba7c-45a5-ad2c-4dba404c4202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:30.191666 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a84ac-ba7c-45a5-ad2c-4dba404c4202 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-272a84ac-ba7c-45a5-ad2c-4dba404c4202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:30.208107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:30.211633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:30.212857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:30.212857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:30.212857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:30.212857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:30.212857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 604/1203] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:30.216401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51084-70ed-4940-9193-39817f9fe538 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:30.316187 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e51084-70ed-4940-9193-39817f9fe538 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:30.344633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:30.350366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d7030-a483-4c9f-8988-a1e24adffcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:30.351026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d7030-a483-4c9f-8988-a1e24adffcea None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:30.351309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d7030-a483-4c9f-8988-a1e24adffcea None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:30.351586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d7030-a483-4c9f-8988-a1e24adffcea None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:30.352300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d7030-a483-4c9f-8988-a1e24adffcea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:30.352608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d7030-a483-4c9f-8988-a1e24adffcea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:30.354009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d7030-a483-4c9f-8988-a1e24adffcea None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:30.365444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 600/1204] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:30.371559 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a84ac-ba7c-45a5-ad2c-4dba404c4202 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:30.423036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:30.467589 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a84ac-ba7c-45a5-ad2c-4dba404c4202 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:30.500087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d765c299-d439-4365-8cb1-72edd959e1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:30.500747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765c299-d439-4365-8cb1-72edd959e1e9 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:30.501126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765c299-d439-4365-8cb1-72edd959e1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:30.501411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765c299-d439-4365-8cb1-72edd959e1e9 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:30.502189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765c299-d439-4365-8cb1-72edd959e1e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:30.503602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d765c299-d439-4365-8cb1-72edd959e1e9 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:30.651998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 605/1205] 10.222.0.41 () {60 vars in 1132 bytes} [Thu May 26 12:27:30 2022] POST /identity/v3/users => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:27:32.861398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91eadb-49ea-4405-a8d7-9ed6724d6719 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:32.861974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91eadb-49ea-4405-a8d7-9ed6724d6719 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:32.861974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c91eadb-49ea-4405-a8d7-9ed6724d6719 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:32.863399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 601/1206] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:32.868969 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10756b-bb04-47f2-b3e1-c8363394a666 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:32.869389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10756b-bb04-47f2-b3e1-c8363394a666 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:32.869527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10756b-bb04-47f2-b3e1-c8363394a666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:32.887438 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9e10756b-bb04-47f2-b3e1-c8363394a666 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:32.888632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9e10756b-bb04-47f2-b3e1-c8363394a666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:32.954026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 606/1207] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:27:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:32.977742 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91eadb-49ea-4405-a8d7-9ed6724d6719 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:33.078132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c91eadb-49ea-4405-a8d7-9ed6724d6719 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:33.111059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7d0a-538d-4a59-8f4a-56f786f71aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:33.111893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7d0a-538d-4a59-8f4a-56f786f71aac None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:33.112138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7d0a-538d-4a59-8f4a-56f786f71aac None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:33.112420 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e7d0a-538d-4a59-8f4a-56f786f71aac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:33.123597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e7d0a-538d-4a59-8f4a-56f786f71aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-302e7d0a-538d-4a59-8f4a-56f786f71aac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:33.131276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:33.135958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:33.136990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 602/1208] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:27:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:33.139049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10756b-bb04-47f2-b3e1-c8363394a666 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:33.176773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:33.234263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10756b-bb04-47f2-b3e1-c8363394a666 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:33.268302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4592a-1437-4ad7-b26e-5a9f20e4b31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:33.268961 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4592a-1437-4ad7-b26e-5a9f20e4b31a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:33.269245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4592a-1437-4ad7-b26e-5a9f20e4b31a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:33.269519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4592a-1437-4ad7-b26e-5a9f20e4b31a None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:33.270288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4592a-1437-4ad7-b26e-5a9f20e4b31a None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:33.270590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4592a-1437-4ad7-b26e-5a9f20e4b31a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:33.271959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4592a-1437-4ad7-b26e-5a9f20e4b31a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:33.279411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 607/1209] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:27:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:33.285182 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7d0a-538d-4a59-8f4a-56f786f71aac None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:33.335584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:33.383919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e7d0a-538d-4a59-8f4a-56f786f71aac None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:33.416391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f7ce7-2b2f-4110-9ec8-8b6de77cff2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:33.417286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f7ce7-2b2f-4110-9ec8-8b6de77cff2a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:33.417599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f7ce7-2b2f-4110-9ec8-8b6de77cff2a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:33.417913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f7ce7-2b2f-4110-9ec8-8b6de77cff2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:33.427733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f7ce7-2b2f-4110-9ec8-8b6de77cff2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:33.429170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f7ce7-2b2f-4110-9ec8-8b6de77cff2a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-2a3f7ce7-2b2f-4110-9ec8-8b6de77cff2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:33.448969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:33.450172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:33.451256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:33.451256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:33.451256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:33.451256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:33.451256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 603/1210] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:33.456238 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4592a-1437-4ad7-b26e-5a9f20e4b31a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:33.553328 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:33.556168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4592a-1437-4ad7-b26e-5a9f20e4b31a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:33.587958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a275-7b6f-4705-9ed0-7e311aa4789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:33.589165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a275-7b6f-4705-9ed0-7e311aa4789f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:33.589446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a275-7b6f-4705-9ed0-7e311aa4789f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:33.589785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb72a275-7b6f-4705-9ed0-7e311aa4789f None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:33.590491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72a275-7b6f-4705-9ed0-7e311aa4789f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:33.590795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72a275-7b6f-4705-9ed0-7e311aa4789f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:33.592150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb72a275-7b6f-4705-9ed0-7e311aa4789f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:33.603234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 608/1211] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:33.609564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f7ce7-2b2f-4110-9ec8-8b6de77cff2a None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:33.710146 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f7ce7-2b2f-4110-9ec8-8b6de77cff2a None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:33.711577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:33.743343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7e984-1929-4e71-b12d-096574f210ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:33.744132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7e984-1929-4e71-b12d-096574f210ca None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:33.744418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7e984-1929-4e71-b12d-096574f210ca None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:33.744724 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7e984-1929-4e71-b12d-096574f210ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:33.751495 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7e984-1929-4e71-b12d-096574f210ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:33.752934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7e984-1929-4e71-b12d-096574f210ca None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ffa7e984-1929-4e71-b12d-096574f210ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:27:33.767650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:33.768763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:33.770124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 604/1212] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:33.774677 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a275-7b6f-4705-9ed0-7e311aa4789f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:33.874382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb72a275-7b6f-4705-9ed0-7e311aa4789f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:33.907876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac9f2-e6dd-42d3-89a2-f0dd59b7e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:33.908541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac9f2-e6dd-42d3-89a2-f0dd59b7e316 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:33.908826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac9f2-e6dd-42d3-89a2-f0dd59b7e316 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:33.909104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ac9f2-e6dd-42d3-89a2-f0dd59b7e316 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:33.909965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac9f2-e6dd-42d3-89a2-f0dd59b7e316 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:33.910283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac9f2-e6dd-42d3-89a2-f0dd59b7e316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:33.911722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ac9f2-e6dd-42d3-89a2-f0dd59b7e316 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:33.929467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 609/1213] 10.222.0.41 () {56 vars in 1143 bytes} [Thu May 26 12:27:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:33.935290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7e984-1929-4e71-b12d-096574f210ca None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:34.033301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7e984-1929-4e71-b12d-096574f210ca None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:34.066537 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e661d6-963c-4bea-8f2f-6a836fa33746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:34.067171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e661d6-963c-4bea-8f2f-6a836fa33746 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:34.067456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e661d6-963c-4bea-8f2f-6a836fa33746 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:34.067734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e661d6-963c-4bea-8f2f-6a836fa33746 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:34.097507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:34.134362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e661d6-963c-4bea-8f2f-6a836fa33746 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:34.135801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e661d6-963c-4bea-8f2f-6a836fa33746 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:34.231604 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 605/1214] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:27:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:34.237486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac9f2-e6dd-42d3-89a2-f0dd59b7e316 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:34.255929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:34.333097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ac9f2-e6dd-42d3-89a2-f0dd59b7e316 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:34.365913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be555ae7-c7bf-4b92-a901-00d865cb79be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:34.366736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555ae7-c7bf-4b92-a901-00d865cb79be None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:34.367281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555ae7-c7bf-4b92-a901-00d865cb79be None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:34.367557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be555ae7-c7bf-4b92-a901-00d865cb79be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:34.377532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be555ae7-c7bf-4b92-a901-00d865cb79be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:34.379051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be555ae7-c7bf-4b92-a901-00d865cb79be None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-be555ae7-c7bf-4b92-a901-00d865cb79be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:34.396224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:34.398628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:34.399735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:34.399735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:34.399735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:34.399735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:34.399735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 610/1215] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:34.403923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e661d6-963c-4bea-8f2f-6a836fa33746 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:34.464851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:34.500554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e661d6-963c-4bea-8f2f-6a836fa33746 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:34.535074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771ea87-6ae0-4e41-9b42-5d61b430009e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:34.535725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771ea87-6ae0-4e41-9b42-5d61b430009e None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:34.536008 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771ea87-6ae0-4e41-9b42-5d61b430009e None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:34.536284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771ea87-6ae0-4e41-9b42-5d61b430009e None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:34.536992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771ea87-6ae0-4e41-9b42-5d61b430009e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:34.537299 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771ea87-6ae0-4e41-9b42-5d61b430009e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:34.538678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771ea87-6ae0-4e41-9b42-5d61b430009e None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:34.549559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 606/1216] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:34.555314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be555ae7-c7bf-4b92-a901-00d865cb79be None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:34.623649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:34.653668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be555ae7-c7bf-4b92-a901-00d865cb79be None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:34.686307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10893282-c589-47ad-ace1-a3db29128dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:34.687088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10893282-c589-47ad-ace1-a3db29128dae None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:34.687372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10893282-c589-47ad-ace1-a3db29128dae None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:34.687646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10893282-c589-47ad-ace1-a3db29128dae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:34.694143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10893282-c589-47ad-ace1-a3db29128dae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:34.695620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10893282-c589-47ad-ace1-a3db29128dae None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-10893282-c589-47ad-ace1-a3db29128dae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:27:34.709903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:34.710977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:34.711881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:27:34.711881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:27:34.711881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:34.711881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:34.711881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:34.711881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:34.711881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:34.711881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:34.711881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 611/1217] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:34.717163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771ea87-6ae0-4e41-9b42-5d61b430009e None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:34.815541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771ea87-6ae0-4e41-9b42-5d61b430009e None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:34.837670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:34.848655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c881a8-7962-49c4-aa97-80618c8d4c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:34.849303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c881a8-7962-49c4-aa97-80618c8d4c99 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:34.849586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c881a8-7962-49c4-aa97-80618c8d4c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:34.849892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c881a8-7962-49c4-aa97-80618c8d4c99 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:34.850667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c881a8-7962-49c4-aa97-80618c8d4c99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:34.850977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c881a8-7962-49c4-aa97-80618c8d4c99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:34.852416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c881a8-7962-49c4-aa97-80618c8d4c99 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:34.864167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 607/1218] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:27:34.871263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10893282-c589-47ad-ace1-a3db29128dae None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:34.969444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10893282-c589-47ad-ace1-a3db29128dae None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:34.998852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:35.004473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55443e99-9cb0-4046-b7ac-b9e8e79f3048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:35.005125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55443e99-9cb0-4046-b7ac-b9e8e79f3048 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:35.005408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55443e99-9cb0-4046-b7ac-b9e8e79f3048 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:35.005709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55443e99-9cb0-4046-b7ac-b9e8e79f3048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:35.006532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55443e99-9cb0-4046-b7ac-b9e8e79f3048 None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=0412209ee10a46558a8baf10b59f89a7) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:35.006841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55443e99-9cb0-4046-b7ac-b9e8e79f3048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:35.008285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55443e99-9cb0-4046-b7ac-b9e8e79f3048 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:35.014036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 612/1219] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:27:34 2022] GET /identity/v3/role_assignments?user.id=0412209ee10a46558a8baf10b59f89a7&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:37.185357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba790c-29e1-4468-8fea-16e6e2576553 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.185983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba790c-29e1-4468-8fea-16e6e2576553 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.185983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba790c-29e1-4468-8fea-16e6e2576553 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.187294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 608/1220] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:37.192558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4abc-dc7a-41b0-8764-f9de956e0287 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.209165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4abc-dc7a-41b0-8764-f9de956e0287 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.209165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f4abc-dc7a-41b0-8764-f9de956e0287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.210315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-421f4abc-dc7a-41b0-8764-f9de956e0287 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:37.211478 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-421f4abc-dc7a-41b0-8764-f9de956e0287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:37.276852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 613/1221] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:27:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:37.299514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba790c-29e1-4468-8fea-16e6e2576553 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:37.400349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba790c-29e1-4468-8fea-16e6e2576553 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:37.434858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584765a-44d3-49a4-a61f-892fd55728e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:37.435649 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584765a-44d3-49a4-a61f-892fd55728e8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.435935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584765a-44d3-49a4-a61f-892fd55728e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.436210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584765a-44d3-49a4-a61f-892fd55728e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.446247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584765a-44d3-49a4-a61f-892fd55728e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-d584765a-44d3-49a4-a61f-892fd55728e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:37.453891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:37.454856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:37.455906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 609/1222] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:27:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:37.461125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4abc-dc7a-41b0-8764-f9de956e0287 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:37.558289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f4abc-dc7a-41b0-8764-f9de956e0287 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:37.580696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:37.591071 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c363-44c6-40c4-9113-56f8ad14c20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:37.591730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c363-44c6-40c4-9113-56f8ad14c20b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.592017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c363-44c6-40c4-9113-56f8ad14c20b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.592296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c363-44c6-40c4-9113-56f8ad14c20b None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.593044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971c363-44c6-40c4-9113-56f8ad14c20b None admin] RBAC: Adding query filter params (name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:37.593349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971c363-44c6-40c4-9113-56f8ad14c20b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:37.594751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971c363-44c6-40c4-9113-56f8ad14c20b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:37.602344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 614/1223] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:27:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:37.608754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584765a-44d3-49a4-a61f-892fd55728e8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:37.651934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:37.705851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584765a-44d3-49a4-a61f-892fd55728e8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:37.738367 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0442f-5cdf-42ba-81e4-d5933f2b6712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:37.747918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0442f-5cdf-42ba-81e4-d5933f2b6712 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.747918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0442f-5cdf-42ba-81e4-d5933f2b6712 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.747918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0442f-5cdf-42ba-81e4-d5933f2b6712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.750446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0442f-5cdf-42ba-81e4-d5933f2b6712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:37.751888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0442f-5cdf-42ba-81e4-d5933f2b6712 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-56c0442f-5cdf-42ba-81e4-d5933f2b6712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:37.768320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:37.769331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:37.770401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:37.770401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:37.770401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:37.770401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:37.770401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 610/1224] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:37.775356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c363-44c6-40c4-9113-56f8ad14c20b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:37.873358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c363-44c6-40c4-9113-56f8ad14c20b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:37.906303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eafcd8-3380-44c6-b559-261317897996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:37.906926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eafcd8-3380-44c6-b559-261317897996 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:37.907226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eafcd8-3380-44c6-b559-261317897996 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:37.907506 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eafcd8-3380-44c6-b559-261317897996 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:37.908230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eafcd8-3380-44c6-b559-261317897996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:37.908542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eafcd8-3380-44c6-b559-261317897996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:37.909943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eafcd8-3380-44c6-b559-261317897996 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:37.921940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 615/1225] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:37.927546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0442f-5cdf-42ba-81e4-d5933f2b6712 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:38.019335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:38.026568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0442f-5cdf-42ba-81e4-d5933f2b6712 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:38.058970 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324386ed-910e-40e7-9bab-bc08410b01fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:38.059757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324386ed-910e-40e7-9bab-bc08410b01fa None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.060044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324386ed-910e-40e7-9bab-bc08410b01fa None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.060319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324386ed-910e-40e7-9bab-bc08410b01fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.067700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324386ed-910e-40e7-9bab-bc08410b01fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:38.069207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324386ed-910e-40e7-9bab-bc08410b01fa None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-324386ed-910e-40e7-9bab-bc08410b01fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:27:38.086282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:38.087474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:38.089340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 611/1226] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:38.093910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eafcd8-3380-44c6-b559-261317897996 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:38.140682 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:38.191389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eafcd8-3380-44c6-b559-261317897996 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:38.223782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abd8dd-ed94-4950-a5a2-7fb9d0d6a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:38.224446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abd8dd-ed94-4950-a5a2-7fb9d0d6a663 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.224730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abd8dd-ed94-4950-a5a2-7fb9d0d6a663 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.226582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abd8dd-ed94-4950-a5a2-7fb9d0d6a663 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.226582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abd8dd-ed94-4950-a5a2-7fb9d0d6a663 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:38.226582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abd8dd-ed94-4950-a5a2-7fb9d0d6a663 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:38.227572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abd8dd-ed94-4950-a5a2-7fb9d0d6a663 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:38.244199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 616/1227] 10.222.0.41 () {56 vars in 1143 bytes} [Thu May 26 12:27:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:38.249522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324386ed-910e-40e7-9bab-bc08410b01fa None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:38.348394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324386ed-910e-40e7-9bab-bc08410b01fa None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:38.381758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a319e7-7fb9-4467-929d-f5c957085eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:38.382547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a319e7-7fb9-4467-929d-f5c957085eba None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.382834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a319e7-7fb9-4467-929d-f5c957085eba None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.383115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a319e7-7fb9-4467-929d-f5c957085eba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.394975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a319e7-7fb9-4467-929d-f5c957085eba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:38.396433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a319e7-7fb9-4467-929d-f5c957085eba None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-09a319e7-7fb9-4467-929d-f5c957085eba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:38.413574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:38.414662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:38.415834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:38.415834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:38.415834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:38.415834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:38.415834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 612/1228] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:38.421139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abd8dd-ed94-4950-a5a2-7fb9d0d6a663 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:38.517799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abd8dd-ed94-4950-a5a2-7fb9d0d6a663 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:38.519946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:38.551395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441dcbf-1d57-4604-b8a6-38366b66d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:38.552381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441dcbf-1d57-4604-b8a6-38366b66d757 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.552381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441dcbf-1d57-4604-b8a6-38366b66d757 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.552585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441dcbf-1d57-4604-b8a6-38366b66d757 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.553292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441dcbf-1d57-4604-b8a6-38366b66d757 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:38.553598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441dcbf-1d57-4604-b8a6-38366b66d757 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:38.555007 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441dcbf-1d57-4604-b8a6-38366b66d757 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:38.565783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 617/1229] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:38.571401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a319e7-7fb9-4467-929d-f5c957085eba None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:38.580669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:38.667549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a319e7-7fb9-4467-929d-f5c957085eba None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:38.700743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd7349-6555-4406-80ab-5e3e9c35b4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:38.701528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd7349-6555-4406-80ab-5e3e9c35b4da None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.701843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd7349-6555-4406-80ab-5e3e9c35b4da None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.702121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd7349-6555-4406-80ab-5e3e9c35b4da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.708468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd7349-6555-4406-80ab-5e3e9c35b4da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:38.709909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd7349-6555-4406-80ab-5e3e9c35b4da None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-16cd7349-6555-4406-80ab-5e3e9c35b4da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:27:38.723457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:38.724315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:38.725313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:27:38.725313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:27:38.725313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:38.725313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:38.725313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:38.725313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:38.725313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:38.725313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:38.725313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 613/1230] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:38.731187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441dcbf-1d57-4604-b8a6-38366b66d757 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:38.830030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441dcbf-1d57-4604-b8a6-38366b66d757 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:38.862429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa1c11e-0bb3-4eaa-8da6-722fde10b6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:38.863086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c11e-0bb3-4eaa-8da6-722fde10b6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:38.863372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c11e-0bb3-4eaa-8da6-722fde10b6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:38.863650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa1c11e-0bb3-4eaa-8da6-722fde10b6f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:38.864728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1c11e-0bb3-4eaa-8da6-722fde10b6f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:38.865042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1c11e-0bb3-4eaa-8da6-722fde10b6f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:38.866516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa1c11e-0bb3-4eaa-8da6-722fde10b6f0 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:38.879420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 618/1231] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:38.885388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd7349-6555-4406-80ab-5e3e9c35b4da None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:38.949589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:38.982055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd7349-6555-4406-80ab-5e3e9c35b4da None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:39.016729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6545a28-0542-43e7-a7f8-a5d7b3ecb5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:39.017607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545a28-0542-43e7-a7f8-a5d7b3ecb5cc None admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:39.017925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545a28-0542-43e7-a7f8-a5d7b3ecb5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:39.018277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545a28-0542-43e7-a7f8-a5d7b3ecb5cc None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/0412209ee10a46558a8baf10b59f89a7/roles/87a7ef7c55854edb887513f9e471440c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:39.032421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6545a28-0542-43e7-a7f8-a5d7b3ecb5cc None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=0412209ee10a46558a8baf10b59f89a7, role_id=87a7ef7c55854edb887513f9e471440c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:39.033882 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6545a28-0542-43e7-a7f8-a5d7b3ecb5cc None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:39.159672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 614/1232] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:27:38 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/0412209ee10a46558a8baf10b59f89a7/roles/87a7ef7c55854edb887513f9e471440c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:27:41.356802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c13d11-b27b-46ba-8e5b-6460127e9c6d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.357331 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c13d11-b27b-46ba-8e5b-6460127e9c6d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.357437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c13d11-b27b-46ba-8e5b-6460127e9c6d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.358746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 619/1233] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:27:41.364150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f5f5-4b57-4fa0-9f5d-60048210c538 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.364522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f5f5-4b57-4fa0-9f5d-60048210c538 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.367310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944f5f5-4b57-4fa0-9f5d-60048210c538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.381334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3944f5f5-4b57-4fa0-9f5d-60048210c538 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:41.382479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3944f5f5-4b57-4fa0-9f5d-60048210c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:41.447031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 615/1234] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:27:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:27:41.470515 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c13d11-b27b-46ba-8e5b-6460127e9c6d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:41.495769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:41.569317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c13d11-b27b-46ba-8e5b-6460127e9c6d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:41.601719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765b245-9ce1-4bea-8d2b-be9e41ed7887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:41.602578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765b245-9ce1-4bea-8d2b-be9e41ed7887 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.602862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765b245-9ce1-4bea-8d2b-be9e41ed7887 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.603135 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765b245-9ce1-4bea-8d2b-be9e41ed7887 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.612840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765b245-9ce1-4bea-8d2b-be9e41ed7887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e765b245-9ce1-4bea-8d2b-be9e41ed7887 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:41.621422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:41.622491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:41.623303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 620/1235] 10.222.0.41 () {56 vars in 1102 bytes} [Thu May 26 12:27:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:41.628804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944f5f5-4b57-4fa0-9f5d-60048210c538 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:41.674425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:41.725246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3944f5f5-4b57-4fa0-9f5d-60048210c538 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:41.758358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe656b-6fa5-47bc-8046-7a7dcc124ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:41.759019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe656b-6fa5-47bc-8046-7a7dcc124ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.759303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe656b-6fa5-47bc-8046-7a7dcc124ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.759580 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fe656b-6fa5-47bc-8046-7a7dcc124ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.760847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe656b-6fa5-47bc-8046-7a7dcc124ed3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:41.761158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe656b-6fa5-47bc-8046-7a7dcc124ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:41.762551 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fe656b-6fa5-47bc-8046-7a7dcc124ed3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:41.770626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 616/1236] 10.222.0.41 () {56 vars in 1103 bytes} [Thu May 26 12:27:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:41.776364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765b245-9ce1-4bea-8d2b-be9e41ed7887 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:41.858305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:41.873638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765b245-9ce1-4bea-8d2b-be9e41ed7887 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:41.906879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4531735-154e-455f-a015-2d27e0065ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:41.907658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4531735-154e-455f-a015-2d27e0065ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:41.907940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4531735-154e-455f-a015-2d27e0065ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:41.908214 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4531735-154e-455f-a015-2d27e0065ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:41.918393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4531735-154e-455f-a015-2d27e0065ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:41.919819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4531735-154e-455f-a015-2d27e0065ee1 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-b4531735-154e-455f-a015-2d27e0065ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:41.936073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:41.937189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:41.938299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:41.938299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:41.938299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:41.938299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:41.938299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 621/1237] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:41.943120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe656b-6fa5-47bc-8046-7a7dcc124ed3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.041791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fe656b-6fa5-47bc-8046-7a7dcc124ed3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:42.051433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:42.075343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c194c5-de59-4930-97e2-bb8b23b42ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:42.076006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c194c5-de59-4930-97e2-bb8b23b42ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.076291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c194c5-de59-4930-97e2-bb8b23b42ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.076568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c194c5-de59-4930-97e2-bb8b23b42ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.077281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c194c5-de59-4930-97e2-bb8b23b42ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:42.077586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c194c5-de59-4930-97e2-bb8b23b42ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:42.079044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c194c5-de59-4930-97e2-bb8b23b42ad5 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:42.090797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 617/1238] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:42.096870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4531735-154e-455f-a015-2d27e0065ee1 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.196213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4531735-154e-455f-a015-2d27e0065ee1 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:42.228736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc7742-c5b6-4210-ab6e-58f011b4563f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:42.229529 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7742-c5b6-4210-ab6e-58f011b4563f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.229846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7742-c5b6-4210-ab6e-58f011b4563f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.230128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc7742-c5b6-4210-ab6e-58f011b4563f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.232818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:42.237550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc7742-c5b6-4210-ab6e-58f011b4563f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:42.239020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc7742-c5b6-4210-ab6e-58f011b4563f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-e7dc7742-c5b6-4210-ab6e-58f011b4563f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:27:42.253545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:42.257465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:42.258652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 622/1239] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:42.261207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c194c5-de59-4930-97e2-bb8b23b42ad5 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.359488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c194c5-de59-4930-97e2-bb8b23b42ad5 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:42.392973 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4973d40-e03c-48ed-9086-abba31f074ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:42.393637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4973d40-e03c-48ed-9086-abba31f074ff None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.393953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4973d40-e03c-48ed-9086-abba31f074ff None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.394230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4973d40-e03c-48ed-9086-abba31f074ff None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.395061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4973d40-e03c-48ed-9086-abba31f074ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:42.395373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4973d40-e03c-48ed-9086-abba31f074ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:42.396828 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4973d40-e03c-48ed-9086-abba31f074ff None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:42.413635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 618/1240] 10.222.0.41 () {56 vars in 1143 bytes} [Thu May 26 12:27:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:42.419435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc7742-c5b6-4210-ab6e-58f011b4563f None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.520373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc7742-c5b6-4210-ab6e-58f011b4563f None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:42.553135 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa5fde-02d9-4bb9-9429-5331cb15a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:42.553799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa5fde-02d9-4bb9-9429-5331cb15a428 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.554082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa5fde-02d9-4bb9-9429-5331cb15a428 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.554355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa5fde-02d9-4bb9-9429-5331cb15a428 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.613195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:42.620323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa5fde-02d9-4bb9-9429-5331cb15a428 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:42.621865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa5fde-02d9-4bb9-9429-5331cb15a428 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:42.716257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 623/1241] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:27:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:42.722183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4973d40-e03c-48ed-9086-abba31f074ff None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.750827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:42.823354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4973d40-e03c-48ed-9086-abba31f074ff None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:42.857065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d006-8ff5-40dd-9279-55a22322bc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:42.857881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d006-8ff5-40dd-9279-55a22322bc67 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:42.858169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d006-8ff5-40dd-9279-55a22322bc67 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:42.858448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222d006-8ff5-40dd-9279-55a22322bc67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:42.868688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d006-8ff5-40dd-9279-55a22322bc67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:42.870718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222d006-8ff5-40dd-9279-55a22322bc67 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-c222d006-8ff5-40dd-9279-55a22322bc67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:42.887929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:42.889161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:42.890158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:42.890158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:42.890158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:42.890158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:42.890158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 619/1242] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:42.895058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa5fde-02d9-4bb9-9429-5331cb15a428 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:42.986806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:42.992498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa5fde-02d9-4bb9-9429-5331cb15a428 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:43.026004 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc304db-f2e3-402e-8421-035b69a7c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:43.026655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc304db-f2e3-402e-8421-035b69a7c297 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.027037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc304db-f2e3-402e-8421-035b69a7c297 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.027368 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc304db-f2e3-402e-8421-035b69a7c297 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.028078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc304db-f2e3-402e-8421-035b69a7c297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:43.028384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc304db-f2e3-402e-8421-035b69a7c297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:43.029762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc304db-f2e3-402e-8421-035b69a7c297 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:43.040639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 624/1243] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:43.046387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d006-8ff5-40dd-9279-55a22322bc67 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:43.125120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:43.145797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222d006-8ff5-40dd-9279-55a22322bc67 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:43.177445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663836b-21b0-4d04-8e3d-6ff551c0381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:43.178270 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663836b-21b0-4d04-8e3d-6ff551c0381c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.178553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663836b-21b0-4d04-8e3d-6ff551c0381c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.178830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663836b-21b0-4d04-8e3d-6ff551c0381c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.186149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663836b-21b0-4d04-8e3d-6ff551c0381c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:43.187590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663836b-21b0-4d04-8e3d-6ff551c0381c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b663836b-21b0-4d04-8e3d-6ff551c0381c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:27:43.201623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:43.202710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:43.207611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:27:43.207611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:27:43.207611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:43.207611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:43.207611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:43.207611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:43.207611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:43.207611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:43.207611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 620/1244] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:43.208718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc304db-f2e3-402e-8421-035b69a7c297 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:43.306644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc304db-f2e3-402e-8421-035b69a7c297 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:43.339028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c035ad7-55da-4734-a592-d57d079d552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:43.339620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035ad7-55da-4734-a592-d57d079d552f None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.339903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035ad7-55da-4734-a592-d57d079d552f None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.340180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c035ad7-55da-4734-a592-d57d079d552f None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.340950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c035ad7-55da-4734-a592-d57d079d552f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:43.341257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c035ad7-55da-4734-a592-d57d079d552f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:43.342716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c035ad7-55da-4734-a592-d57d079d552f None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:43.354656 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 625/1245] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:43.360813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663836b-21b0-4d04-8e3d-6ff551c0381c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:43.458999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663836b-21b0-4d04-8e3d-6ff551c0381c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:43.491647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a6d29-02f7-49f6-8225-063f4d920996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:43.492553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a6d29-02f7-49f6-8225-063f4d920996 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:43.492833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a6d29-02f7-49f6-8225-063f4d920996 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:43.493105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a6d29-02f7-49f6-8225-063f4d920996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:43.493957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a6d29-02f7-49f6-8225-063f4d920996 None admin] RBAC: Adding query filter params (role.id=87a7ef7c55854edb887513f9e471440c, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=0412209ee10a46558a8baf10b59f89a7) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:43.494268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a6d29-02f7-49f6-8225-063f4d920996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:43.496277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a6d29-02f7-49f6-8225-063f4d920996 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:43.502050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 621/1246] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:27:43 2022] GET /identity/v3/role_assignments?user.id=0412209ee10a46558a8baf10b59f89a7&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=87a7ef7c55854edb887513f9e471440c => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:45.738223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd16c1b-e320-4cec-b991-45ffede4472b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:45.738789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd16c1b-e320-4cec-b991-45ffede4472b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:45.738789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd16c1b-e320-4cec-b991-45ffede4472b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:45.740237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 626/1247] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:45.745572 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36152d73-6537-4c45-9fc8-1a38c423593e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:45.746029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36152d73-6537-4c45-9fc8-1a38c423593e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:45.746155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36152d73-6537-4c45-9fc8-1a38c423593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:45.751109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:45.763394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-36152d73-6537-4c45-9fc8-1a38c423593e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:45.764620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-36152d73-6537-4c45-9fc8-1a38c423593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:45.829269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 622/1248] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:27:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:45.852398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd16c1b-e320-4cec-b991-45ffede4472b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:45.871513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:45.955021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd16c1b-e320-4cec-b991-45ffede4472b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:45.987617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e3781-2f95-4585-a18f-0923a8b7572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:45.988483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e3781-2f95-4585-a18f-0923a8b7572a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:45.988722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e3781-2f95-4585-a18f-0923a8b7572a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:45.988999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e3781-2f95-4585-a18f-0923a8b7572a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:45.999814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e3781-2f95-4585-a18f-0923a8b7572a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-c22e3781-2f95-4585-a18f-0923a8b7572a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:46.007276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:46.008348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:46.009389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 627/1249] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:27:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:46.015509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36152d73-6537-4c45-9fc8-1a38c423593e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.111927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36152d73-6537-4c45-9fc8-1a38c423593e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.141288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:46.146060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7a224-2fb0-4df2-8b20-fee0923d603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.146794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7a224-2fb0-4df2-8b20-fee0923d603b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.147055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7a224-2fb0-4df2-8b20-fee0923d603b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.147337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7a224-2fb0-4df2-8b20-fee0923d603b None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.148070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7a224-2fb0-4df2-8b20-fee0923d603b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:46.148375 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7a224-2fb0-4df2-8b20-fee0923d603b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:46.149744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7a224-2fb0-4df2-8b20-fee0923d603b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:46.158107 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 623/1250] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:46.163763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e3781-2f95-4585-a18f-0923a8b7572a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.241552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:46.264738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e3781-2f95-4585-a18f-0923a8b7572a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.296957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d6032-d85b-4726-833e-630016c6aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.297865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d6032-d85b-4726-833e-630016c6aba4 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.298146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d6032-d85b-4726-833e-630016c6aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.298416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d6032-d85b-4726-833e-630016c6aba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.309739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d6032-d85b-4726-833e-630016c6aba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:46.317387 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d6032-d85b-4726-833e-630016c6aba4 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-a47d6032-d85b-4726-833e-630016c6aba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:46.330144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:46.331175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:46.332225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:46.332225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:46.332225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:46.332225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:46.332225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 628/1251] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:46.337064 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7a224-2fb0-4df2-8b20-fee0923d603b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.436284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7a224-2fb0-4df2-8b20-fee0923d603b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.468298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee7cf7-04bf-457f-93b3-b416ffcf20a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.468950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7cf7-04bf-457f-93b3-b416ffcf20a6 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.469232 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7cf7-04bf-457f-93b3-b416ffcf20a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.469508 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ee7cf7-04bf-457f-93b3-b416ffcf20a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.470258 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee7cf7-04bf-457f-93b3-b416ffcf20a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:46.470565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee7cf7-04bf-457f-93b3-b416ffcf20a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:46.471916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ee7cf7-04bf-457f-93b3-b416ffcf20a6 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:46.483942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 624/1252] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:46.489440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d6032-d85b-4726-833e-630016c6aba4 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.587491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d6032-d85b-4726-833e-630016c6aba4 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.613396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:46.621989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773bfea-a2d0-468c-b8d2-0f95417353dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.622848 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773bfea-a2d0-468c-b8d2-0f95417353dd None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.623216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773bfea-a2d0-468c-b8d2-0f95417353dd None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.623502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773bfea-a2d0-468c-b8d2-0f95417353dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.630859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773bfea-a2d0-468c-b8d2-0f95417353dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:46.632323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773bfea-a2d0-468c-b8d2-0f95417353dd None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-5773bfea-a2d0-468c-b8d2-0f95417353dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:27:46.646324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:46.647262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:46.648217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 629/1253] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:46.653919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee7cf7-04bf-457f-93b3-b416ffcf20a6 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.708245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:46.750513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ee7cf7-04bf-457f-93b3-b416ffcf20a6 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.782967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6377014-c2f4-4a2f-ade1-2cf8e5d01e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.783631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6377014-c2f4-4a2f-ade1-2cf8e5d01e0c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.783918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6377014-c2f4-4a2f-ade1-2cf8e5d01e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.784200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6377014-c2f4-4a2f-ade1-2cf8e5d01e0c None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.785025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6377014-c2f4-4a2f-ade1-2cf8e5d01e0c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:46.785338 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6377014-c2f4-4a2f-ade1-2cf8e5d01e0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:46.786791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6377014-c2f4-4a2f-ade1-2cf8e5d01e0c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:46.804372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 625/1254] 10.222.0.41 () {56 vars in 1143 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:46.810318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773bfea-a2d0-468c-b8d2-0f95417353dd None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:46.908009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773bfea-a2d0-468c-b8d2-0f95417353dd None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:46.941855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04040a58-2515-4c23-8059-147a8d5177b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:46.942503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04040a58-2515-4c23-8059-147a8d5177b3 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:46.942792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04040a58-2515-4c23-8059-147a8d5177b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:46.943073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04040a58-2515-4c23-8059-147a8d5177b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:46.999844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:47.012247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04040a58-2515-4c23-8059-147a8d5177b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.013728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04040a58-2515-4c23-8059-147a8d5177b3 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.108896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 630/1255] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:27:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:47.114872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6377014-c2f4-4a2f-ade1-2cf8e5d01e0c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:47.220652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6377014-c2f4-4a2f-ade1-2cf8e5d01e0c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.233258 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:47.253806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cea2a3-2c33-46e3-8f88-8a3625e4cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.254588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea2a3-2c33-46e3-8f88-8a3625e4cca2 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.254873 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea2a3-2c33-46e3-8f88-8a3625e4cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.255180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cea2a3-2c33-46e3-8f88-8a3625e4cca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.265789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cea2a3-2c33-46e3-8f88-8a3625e4cca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.267308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cea2a3-2c33-46e3-8f88-8a3625e4cca2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-40cea2a3-2c33-46e3-8f88-8a3625e4cca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:47.284912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:47.291090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:47.291967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:47.291967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:47.291967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:47.291967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:47.291967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 626/1256] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:47.292252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04040a58-2515-4c23-8059-147a8d5177b3 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:47.377452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:47.389807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04040a58-2515-4c23-8059-147a8d5177b3 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.422378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d38b0-3c15-41e3-a4f0-2be46a5c6945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.423035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d38b0-3c15-41e3-a4f0-2be46a5c6945 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.423322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d38b0-3c15-41e3-a4f0-2be46a5c6945 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.423601 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d38b0-3c15-41e3-a4f0-2be46a5c6945 None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.424379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d38b0-3c15-41e3-a4f0-2be46a5c6945 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:47.424685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d38b0-3c15-41e3-a4f0-2be46a5c6945 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.426185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d38b0-3c15-41e3-a4f0-2be46a5c6945 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.438715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 631/1257] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:47.444386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cea2a3-2c33-46e3-8f88-8a3625e4cca2 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:47.543713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cea2a3-2c33-46e3-8f88-8a3625e4cca2 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.577814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea0857-cd58-409e-bdca-dcf0ac4bf2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.578602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea0857-cd58-409e-bdca-dcf0ac4bf2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.578888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea0857-cd58-409e-bdca-dcf0ac4bf2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.579164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea0857-cd58-409e-bdca-dcf0ac4bf2f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.585729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea0857-cd58-409e-bdca-dcf0ac4bf2f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.587212 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea0857-cd58-409e-bdca-dcf0ac4bf2f8 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-55ea0857-cd58-409e-bdca-dcf0ac4bf2f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:27:47.600756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:47.601832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:47.602885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:27:47.602885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:27:47.602885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:47.602885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:47.602885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:47.602885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:47.602885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:47.602885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:47.602885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 627/1258] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:47.608241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d38b0-3c15-41e3-a4f0-2be46a5c6945 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:47.707012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d38b0-3c15-41e3-a4f0-2be46a5c6945 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.739138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52564941-f938-4495-9425-7ea858425193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.739783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564941-f938-4495-9425-7ea858425193 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.740065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564941-f938-4495-9425-7ea858425193 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.740344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52564941-f938-4495-9425-7ea858425193 None admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.741171 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564941-f938-4495-9425-7ea858425193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:47.741474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564941-f938-4495-9425-7ea858425193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.743189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52564941-f938-4495-9425-7ea858425193 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.755146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 632/1259] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:27:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:47.761308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea0857-cd58-409e-bdca-dcf0ac4bf2f8 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:47.786154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:47.857827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea0857-cd58-409e-bdca-dcf0ac4bf2f8 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:47.893992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0816e0-569a-454f-bb3b-74ff26430c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:47.894635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0816e0-569a-454f-bb3b-74ff26430c28 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:47.894917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0816e0-569a-454f-bb3b-74ff26430c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:47.895191 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0816e0-569a-454f-bb3b-74ff26430c28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:47.896008 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0816e0-569a-454f-bb3b-74ff26430c28 None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=0412209ee10a46558a8baf10b59f89a7) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:47.896317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0816e0-569a-454f-bb3b-74ff26430c28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:47.897755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0816e0-569a-454f-bb3b-74ff26430c28 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:47.903595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 628/1260] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:27:47 2022] GET /identity/v3/role_assignments?user.id=0412209ee10a46558a8baf10b59f89a7&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:50.075925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3a503-5b21-4a66-bc01-bc87bd434a29 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:50.076464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3a503-5b21-4a66-bc01-bc87bd434a29 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:50.076587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3a503-5b21-4a66-bc01-bc87bd434a29 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:50.078008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 633/1261] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:50.083429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813553c-eece-46aa-8bf2-84490bed67e6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:50.083834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813553c-eece-46aa-8bf2-84490bed67e6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:50.084623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813553c-eece-46aa-8bf2-84490bed67e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:50.100785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9813553c-eece-46aa-8bf2-84490bed67e6 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:50.101986 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9813553c-eece-46aa-8bf2-84490bed67e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:50.167466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 629/1262] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:27:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:50.190199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3a503-5b21-4a66-bc01-bc87bd434a29 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:50.200903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:50.290024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3a503-5b21-4a66-bc01-bc87bd434a29 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:50.323493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cebf5-da61-46fd-9e9e-1f445ac43b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:50.324269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cebf5-da61-46fd-9e9e-1f445ac43b90 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:50.324593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cebf5-da61-46fd-9e9e-1f445ac43b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:50.324867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cebf5-da61-46fd-9e9e-1f445ac43b90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:50.334977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cebf5-da61-46fd-9e9e-1f445ac43b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-073cebf5-da61-46fd-9e9e-1f445ac43b90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:50.342699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:50.343847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:50.344744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 634/1263] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:27:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:50.350112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813553c-eece-46aa-8bf2-84490bed67e6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:50.369489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:50.447963 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813553c-eece-46aa-8bf2-84490bed67e6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:50.481808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13376400-515e-4453-aea4-9c3b54bac87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:50.482537 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376400-515e-4453-aea4-9c3b54bac87c None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:50.482765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376400-515e-4453-aea4-9c3b54bac87c None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:50.483049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13376400-515e-4453-aea4-9c3b54bac87c None admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:50.483790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13376400-515e-4453-aea4-9c3b54bac87c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:50.484101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13376400-515e-4453-aea4-9c3b54bac87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:50.485470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13376400-515e-4453-aea4-9c3b54bac87c None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:50.493684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 630/1264] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:27:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:50.499509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cebf5-da61-46fd-9e9e-1f445ac43b90 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:50.567396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:50.599339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cebf5-da61-46fd-9e9e-1f445ac43b90 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:50.632429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b55871-648e-4385-b028-8f98a1d13eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:50.638990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b55871-648e-4385-b028-8f98a1d13eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:50.638990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b55871-648e-4385-b028-8f98a1d13eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:50.638990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b55871-648e-4385-b028-8f98a1d13eb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:50.643918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b55871-648e-4385-b028-8f98a1d13eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:50.645365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b55871-648e-4385-b028-8f98a1d13eb7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-79b55871-648e-4385-b028-8f98a1d13eb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:50.662314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:50.669708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:50.670835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:50.670835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:50.670835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:50.670835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:50.670835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 635/1265] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:50.671237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13376400-515e-4453-aea4-9c3b54bac87c None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:50.749958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:50.768549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13376400-515e-4453-aea4-9c3b54bac87c None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:50.800405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524139a-297c-446e-91d7-8a93132e0aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:50.801048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524139a-297c-446e-91d7-8a93132e0aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:50.801331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524139a-297c-446e-91d7-8a93132e0aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:50.801607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524139a-297c-446e-91d7-8a93132e0aa3 None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:50.802340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524139a-297c-446e-91d7-8a93132e0aa3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:50.802645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524139a-297c-446e-91d7-8a93132e0aa3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:50.803988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524139a-297c-446e-91d7-8a93132e0aa3 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:50.816312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 631/1266] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:50.822168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b55871-648e-4385-b028-8f98a1d13eb7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:50.919620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b55871-648e-4385-b028-8f98a1d13eb7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:50.938779 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:50.952698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7711f-77dc-4747-bb91-839cef46e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:50.953491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7711f-77dc-4747-bb91-839cef46e52b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:50.953812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7711f-77dc-4747-bb91-839cef46e52b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:50.954095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a7711f-77dc-4747-bb91-839cef46e52b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:50.961370 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7711f-77dc-4747-bb91-839cef46e52b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:50.962847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a7711f-77dc-4747-bb91-839cef46e52b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-39a7711f-77dc-4747-bb91-839cef46e52b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:27:50.977151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:50.982947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:50.984108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 636/1267] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:50.986131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524139a-297c-446e-91d7-8a93132e0aa3 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.085086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524139a-297c-446e-91d7-8a93132e0aa3 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.119217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46ae42-c218-46e3-a1d2-d0c965a9a8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.120373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46ae42-c218-46e3-a1d2-d0c965a9a8ec None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.120658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46ae42-c218-46e3-a1d2-d0c965a9a8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.120932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c46ae42-c218-46e3-a1d2-d0c965a9a8ec None admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.121782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46ae42-c218-46e3-a1d2-d0c965a9a8ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:51.122092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46ae42-c218-46e3-a1d2-d0c965a9a8ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.123502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c46ae42-c218-46e3-a1d2-d0c965a9a8ec None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.131861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:51.140480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 632/1268] 10.222.0.41 () {56 vars in 1143 bytes} [Thu May 26 12:27:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:51.146216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7711f-77dc-4747-bb91-839cef46e52b None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.252132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a7711f-77dc-4747-bb91-839cef46e52b None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.284737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6b25-ded4-4695-a504-208b4b93e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.285516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6b25-ded4-4695-a504-208b4b93e946 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.285829 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6b25-ded4-4695-a504-208b4b93e946 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.286105 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae6b25-ded4-4695-a504-208b4b93e946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.297493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae6b25-ded4-4695-a504-208b4b93e946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.298984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae6b25-ded4-4695-a504-208b4b93e946 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-6eae6b25-ded4-4695-a504-208b4b93e946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:51.316299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:51.317352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:51.318334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:51.318334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:51.318334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:51.318334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:51.318334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 637/1269] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:51.323877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46ae42-c218-46e3-a1d2-d0c965a9a8ec None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.420730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c46ae42-c218-46e3-a1d2-d0c965a9a8ec None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.454900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cd375-5c8e-48ed-84c8-f05d7fe678ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.455622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd375-5c8e-48ed-84c8-f05d7fe678ed None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.455932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd375-5c8e-48ed-84c8-f05d7fe678ed None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.456212 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd375-5c8e-48ed-84c8-f05d7fe678ed None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.456926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cd375-5c8e-48ed-84c8-f05d7fe678ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:51.457232 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cd375-5c8e-48ed-84c8-f05d7fe678ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.458674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cd375-5c8e-48ed-84c8-f05d7fe678ed None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.469797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 633/1270] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:51.475453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6b25-ded4-4695-a504-208b4b93e946 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.507756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:51.573192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae6b25-ded4-4695-a504-208b4b93e946 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.605123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242bd6a-5834-402c-bf12-a006f6bbd6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.605930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242bd6a-5834-402c-bf12-a006f6bbd6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.606212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242bd6a-5834-402c-bf12-a006f6bbd6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.606488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242bd6a-5834-402c-bf12-a006f6bbd6a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.612993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242bd6a-5834-402c-bf12-a006f6bbd6a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.614464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242bd6a-5834-402c-bf12-a006f6bbd6a7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-4242bd6a-5834-402c-bf12-a006f6bbd6a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:27:51.629615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:51.630704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:51.631613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:27:51.631613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:27:51.631613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:51.631613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:51.631613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:51.631613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:51.631613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:51.631613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:51.631613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 638/1271] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:27:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:51.636804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cd375-5c8e-48ed-84c8-f05d7fe678ed None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.693944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:51.733174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cd375-5c8e-48ed-84c8-f05d7fe678ed None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.765530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad37004-e105-44f8-a355-d38b0973ebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.766155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37004-e105-44f8-a355-d38b0973ebcd None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.766445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37004-e105-44f8-a355-d38b0973ebcd None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.766728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad37004-e105-44f8-a355-d38b0973ebcd None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.767506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad37004-e105-44f8-a355-d38b0973ebcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:51.767826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad37004-e105-44f8-a355-d38b0973ebcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.769246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad37004-e105-44f8-a355-d38b0973ebcd None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:51.780771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 634/1272] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:27:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:51.786986 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242bd6a-5834-402c-bf12-a006f6bbd6a7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:51.879170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:51.887999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242bd6a-5834-402c-bf12-a006f6bbd6a7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:51.920478 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871307a-43d6-43de-a152-64ef23ee2eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:51.923594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871307a-43d6-43de-a152-64ef23ee2eff None admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:51.923594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871307a-43d6-43de-a152-64ef23ee2eff None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:51.923594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871307a-43d6-43de-a152-64ef23ee2eff None admin] PATH_INFO: `/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/0412209ee10a46558a8baf10b59f89a7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:51.923875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871307a-43d6-43de-a152-64ef23ee2eff None admin] RBAC: Authorizing `identity:create_grant(project_id=31b334e262244d57bc2ef756a3ae6797, user_id=0412209ee10a46558a8baf10b59f89a7, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:51.925314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871307a-43d6-43de-a152-64ef23ee2eff None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:52.087324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 639/1273] 10.222.0.41 () {58 vars in 1439 bytes} [Thu May 26 12:27:51 2022] PUT /identity/v3/projects/31b334e262244d57bc2ef756a3ae6797/users/0412209ee10a46558a8baf10b59f89a7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:27:54.277071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07984d-2636-421b-b760-b51f6449fa3f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:54.277586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07984d-2636-421b-b760-b51f6449fa3f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:54.277586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07984d-2636-421b-b760-b51f6449fa3f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:54.279035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 635/1274] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:54.284192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a116e-b472-4f9d-8294-644a532b68a4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:54.284611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a116e-b472-4f9d-8294-644a532b68a4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:54.284754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a116e-b472-4f9d-8294-644a532b68a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:54.300638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5c6a116e-b472-4f9d-8294-644a532b68a4 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:54.301865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5c6a116e-b472-4f9d-8294-644a532b68a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:54.368435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 640/1275] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:27:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:27:54.392268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07984d-2636-421b-b760-b51f6449fa3f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:54.490145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07984d-2636-421b-b760-b51f6449fa3f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:54.508217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:54.524161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833ce08-f296-4659-8917-1f63f60126f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:54.528854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ce08-f296-4659-8917-1f63f60126f1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:54.528854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ce08-f296-4659-8917-1f63f60126f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:54.528854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ce08-f296-4659-8917-1f63f60126f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:54.535731 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833ce08-f296-4659-8917-1f63f60126f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-0833ce08-f296-4659-8917-1f63f60126f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:54.543655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:54.544766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:54.545993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 636/1276] 10.222.0.41 () {56 vars in 1096 bytes} [Thu May 26 12:27:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:54.550750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a116e-b472-4f9d-8294-644a532b68a4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:54.629962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:54.646873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a116e-b472-4f9d-8294-644a532b68a4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:54.679151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df7c2-d73d-4908-93ab-575ca09cbe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:54.679854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df7c2-d73d-4908-93ab-575ca09cbe89 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:54.680147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df7c2-d73d-4908-93ab-575ca09cbe89 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:54.680428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10df7c2-d73d-4908-93ab-575ca09cbe89 None admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:54.681176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df7c2-d73d-4908-93ab-575ca09cbe89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:54.681498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df7c2-d73d-4908-93ab-575ca09cbe89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:54.683470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10df7c2-d73d-4908-93ab-575ca09cbe89 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:54.691487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 641/1277] 10.222.0.41 () {56 vars in 1099 bytes} [Thu May 26 12:27:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:54.697280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833ce08-f296-4659-8917-1f63f60126f1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:54.797616 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833ce08-f296-4659-8917-1f63f60126f1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:54.830620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba86d4-d412-4d04-b9c9-e6ea88a2c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:54.831397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba86d4-d412-4d04-b9c9-e6ea88a2c105 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:54.831681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba86d4-d412-4d04-b9c9-e6ea88a2c105 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:54.831957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ba86d4-d412-4d04-b9c9-e6ea88a2c105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:54.843060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba86d4-d412-4d04-b9c9-e6ea88a2c105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:54.844498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ba86d4-d412-4d04-b9c9-e6ea88a2c105 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b3ba86d4-d412-4d04-b9c9-e6ea88a2c105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:54.861829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:54.862923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:54.864180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:54.864180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:54.864180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:54.864180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:54.864180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 637/1278] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:54.868946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df7c2-d73d-4908-93ab-575ca09cbe89 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:54.968653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10df7c2-d73d-4908-93ab-575ca09cbe89 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:55.001220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e09db-0349-4782-a708-18e8cedb3bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:55.002141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e09db-0349-4782-a708-18e8cedb3bdc None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:55.002254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e09db-0349-4782-a708-18e8cedb3bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:55.002446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e09db-0349-4782-a708-18e8cedb3bdc None admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:55.003158 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e09db-0349-4782-a708-18e8cedb3bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:55.003465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e09db-0349-4782-a708-18e8cedb3bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:55.004821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e09db-0349-4782-a708-18e8cedb3bdc None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:55.016146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 642/1279] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:55.021787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba86d4-d412-4d04-b9c9-e6ea88a2c105 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:55.053633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:55.121533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ba86d4-d412-4d04-b9c9-e6ea88a2c105 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:55.153903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880d718-9a58-4b6d-a75c-3f16b828b850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:55.154693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d718-9a58-4b6d-a75c-3f16b828b850 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:55.154980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d718-9a58-4b6d-a75c-3f16b828b850 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:55.155260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a880d718-9a58-4b6d-a75c-3f16b828b850 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:55.162515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880d718-9a58-4b6d-a75c-3f16b828b850 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:55.163947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a880d718-9a58-4b6d-a75c-3f16b828b850 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-a880d718-9a58-4b6d-a75c-3f16b828b850 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:27:55.178458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:55.179544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:55.180765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 638/1280] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:55.185683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e09db-0349-4782-a708-18e8cedb3bdc None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:55.189513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:55.281326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e09db-0349-4782-a708-18e8cedb3bdc None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:55.316259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e68fe-26e9-4d47-a402-402756218df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:55.316928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e68fe-26e9-4d47-a402-402756218df7 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:55.317216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e68fe-26e9-4d47-a402-402756218df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:55.317494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e68fe-26e9-4d47-a402-402756218df7 None admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:55.318372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e68fe-26e9-4d47-a402-402756218df7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:55.318684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e68fe-26e9-4d47-a402-402756218df7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:55.320111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e68fe-26e9-4d47-a402-402756218df7 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:55.336762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 643/1281] 10.222.0.41 () {56 vars in 1143 bytes} [Thu May 26 12:27:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:55.342913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880d718-9a58-4b6d-a75c-3f16b828b850 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:55.431174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:55.440826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a880d718-9a58-4b6d-a75c-3f16b828b850 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:55.472337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee85be0-2e04-45e3-9621-d227a18679a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:55.472967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee85be0-2e04-45e3-9621-d227a18679a1 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:55.473248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee85be0-2e04-45e3-9621-d227a18679a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:55.473522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee85be0-2e04-45e3-9621-d227a18679a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:55.538538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee85be0-2e04-45e3-9621-d227a18679a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:55.540034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee85be0-2e04-45e3-9621-d227a18679a1 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:55.628847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:55.639505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 639/1282] 10.222.0.41 () {58 vars in 1282 bytes} [Thu May 26 12:27:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:55.645455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e68fe-26e9-4d47-a402-402756218df7 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:55.705047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:55.741179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e68fe-26e9-4d47-a402-402756218df7 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:55.775609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f81f34-bea4-4d74-b41c-8ce36b95dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:55.776405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f81f34-bea4-4d74-b41c-8ce36b95dd5a None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:55.776692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f81f34-bea4-4d74-b41c-8ce36b95dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:55.776967 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f81f34-bea4-4d74-b41c-8ce36b95dd5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:55.786692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f81f34-bea4-4d74-b41c-8ce36b95dd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:55.788137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f81f34-bea4-4d74-b41c-8ce36b95dd5a None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-81f81f34-bea4-4d74-b41c-8ce36b95dd5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:55.804915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:55.805930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:55.807758 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:27:55.807758 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:55.807758 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:27:55.807758 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:55.807758 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 644/1283] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:55.812217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee85be0-2e04-45e3-9621-d227a18679a1 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:55.909637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee85be0-2e04-45e3-9621-d227a18679a1 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:55.943745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58a4ab-def2-47ea-ac57-89f19d53d29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:55.944400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58a4ab-def2-47ea-ac57-89f19d53d29f None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:55.944683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58a4ab-def2-47ea-ac57-89f19d53d29f None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:55.944966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c58a4ab-def2-47ea-ac57-89f19d53d29f None admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:55.945684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58a4ab-def2-47ea-ac57-89f19d53d29f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:55.946008 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58a4ab-def2-47ea-ac57-89f19d53d29f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:55.947350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c58a4ab-def2-47ea-ac57-89f19d53d29f None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:55.959013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 640/1284] 10.222.0.41 () {56 vars in 1109 bytes} [Thu May 26 12:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:27:55.964919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f81f34-bea4-4d74-b41c-8ce36b95dd5a None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:56.064901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f81f34-bea4-4d74-b41c-8ce36b95dd5a None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:56.085217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:56.098836 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961a1d-78fd-4892-ba5a-b28d0215c139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:56.099629 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961a1d-78fd-4892-ba5a-b28d0215c139 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.099934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961a1d-78fd-4892-ba5a-b28d0215c139 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.100212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34961a1d-78fd-4892-ba5a-b28d0215c139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.107415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34961a1d-78fd-4892-ba5a-b28d0215c139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:56.108959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34961a1d-78fd-4892-ba5a-b28d0215c139 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application [None req-34961a1d-78fd-4892-ba5a-b28d0215c139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:27:56.123713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application with Lock( May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:56.124727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:56.125815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:27:56.125815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:27:56.125815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:56.125815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:56.125815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:56.125815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:56.125815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:27:56.125815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: ERROR keystone.server.flask.application May 26 12:27:56.125815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 645/1285] 10.222.0.41 () {56 vars in 1111 bytes} [Thu May 26 12:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:27:56.130687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58a4ab-def2-47ea-ac57-89f19d53d29f None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:56.179787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:56.226578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c58a4ab-def2-47ea-ac57-89f19d53d29f None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:56.259064 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd61acb-0297-49d2-977a-19773ecb0b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:56.259713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61acb-0297-49d2-977a-19773ecb0b03 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.260043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61acb-0297-49d2-977a-19773ecb0b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.260327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd61acb-0297-49d2-977a-19773ecb0b03 None admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.261099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61acb-0297-49d2-977a-19773ecb0b03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:56.261410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61acb-0297-49d2-977a-19773ecb0b03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:56.262865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd61acb-0297-49d2-977a-19773ecb0b03 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:56.275028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 641/1286] 10.222.0.41 () {56 vars in 1148 bytes} [Thu May 26 12:27:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:27:56.281386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961a1d-78fd-4892-ba5a-b28d0215c139 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:56.379659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34961a1d-78fd-4892-ba5a-b28d0215c139 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:56.413099 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4218f75-a915-49eb-9170-edb4541ddd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:56.413781 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218f75-a915-49eb-9170-edb4541ddd8b None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:56.414067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218f75-a915-49eb-9170-edb4541ddd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:56.414343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218f75-a915-49eb-9170-edb4541ddd8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:56.415162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218f75-a915-49eb-9170-edb4541ddd8b None admin] RBAC: Adding query filter params (role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3, scope.project.id=31b334e262244d57bc2ef756a3ae6797, user.id=0412209ee10a46558a8baf10b59f89a7) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:56.415473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218f75-a915-49eb-9170-edb4541ddd8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:56.417455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218f75-a915-49eb-9170-edb4541ddd8b None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:56.423105 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 646/1287] 10.222.0.41 () {56 vars in 1374 bytes} [Thu May 26 12:27:56 2022] GET /identity/v3/role_assignments?user.id=0412209ee10a46558a8baf10b59f89a7&scope.project.id=31b334e262244d57bc2ef756a3ae6797&role.id=3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:58.623492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea2ac7-9b60-4663-89f0-1a2187d30f45 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:58.624015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea2ac7-9b60-4663-89f0-1a2187d30f45 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:58.624129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea2ac7-9b60-4663-89f0-1a2187d30f45 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:58.625407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 642/1288] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:58.630738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a07d10-fd01-402f-b83a-8f70cdcadbc6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:58.631127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a07d10-fd01-402f-b83a-8f70cdcadbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:58.631292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a07d10-fd01-402f-b83a-8f70cdcadbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:58.647790 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-99a07d10-fd01-402f-b83a-8f70cdcadbc6 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:58.648970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-99a07d10-fd01-402f-b83a-8f70cdcadbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:58.678811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:58.714667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 647/1289] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:27:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:58.736619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea2ac7-9b60-4663-89f0-1a2187d30f45 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:58.836239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea2ac7-9b60-4663-89f0-1a2187d30f45 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:58.846647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:58.868737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c6986-1d45-43c8-b85d-62a756906998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:58.879840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c6986-1d45-43c8-b85d-62a756906998 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:58.879840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c6986-1d45-43c8-b85d-62a756906998 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:58.879840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c6986-1d45-43c8-b85d-62a756906998 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:58.879840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c6986-1d45-43c8-b85d-62a756906998 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:58.879840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c6986-1d45-43c8-b85d-62a756906998 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-ec3c6986-1d45-43c8-b85d-62a756906998 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:58.883867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:58.885746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:27:58.886985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 643/1290] 10.222.0.41 () {56 vars in 1117 bytes} [Thu May 26 12:27:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:58.891774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a07d10-fd01-402f-b83a-8f70cdcadbc6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:58.987639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a07d10-fd01-402f-b83a-8f70cdcadbc6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:59.020325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55522cd5-fddf-4572-9da0-fef059b5d632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:59.020975 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522cd5-fddf-4572-9da0-fef059b5d632 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:59.021255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522cd5-fddf-4572-9da0-fef059b5d632 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:59.021530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55522cd5-fddf-4572-9da0-fef059b5d632 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:59.022257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55522cd5-fddf-4572-9da0-fef059b5d632 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:59.022562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55522cd5-fddf-4572-9da0-fef059b5d632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:59.023911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55522cd5-fddf-4572-9da0-fef059b5d632 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:59.028598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 648/1291] 10.222.0.41 () {56 vars in 1116 bytes} [Thu May 26 12:27:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:59.034225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c6986-1d45-43c8-b85d-62a756906998 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:59.133378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c6986-1d45-43c8-b85d-62a756906998 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:59.165160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1840603-3338-41c6-9c4e-70f371006184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:59.165857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840603-3338-41c6-9c4e-70f371006184 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:59.166628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840603-3338-41c6-9c4e-70f371006184 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:59.166916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1840603-3338-41c6-9c4e-70f371006184 None admin] PATH_INFO: `/v3/services` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:59.167617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1840603-3338-41c6-9c4e-70f371006184 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:59.167925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1840603-3338-41c6-9c4e-70f371006184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:59.169281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1840603-3338-41c6-9c4e-70f371006184 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:59.173786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 644/1292] 10.222.0.41 () {56 vars in 1116 bytes} [Thu May 26 12:27:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:01.319765 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af218799-12dc-4b27-af21-85eae35454e2 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.320327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af218799-12dc-4b27-af21-85eae35454e2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.320327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af218799-12dc-4b27-af21-85eae35454e2 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.321721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 649/1293] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:01.327939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6d8c-71bb-4b7d-98a9-aa13acd6ed83 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.328331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6d8c-71bb-4b7d-98a9-aa13acd6ed83 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.328510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da6d8c-71bb-4b7d-98a9-aa13acd6ed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.345926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e4da6d8c-71bb-4b7d-98a9-aa13acd6ed83 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:01.347180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e4da6d8c-71bb-4b7d-98a9-aa13acd6ed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:01.378398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:01.415288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 645/1294] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:28:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:28:01.438251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af218799-12dc-4b27-af21-85eae35454e2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:01.469345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:01.540742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af218799-12dc-4b27-af21-85eae35454e2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:01.577557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58404af-dc54-4213-8bbf-c1082f2cefe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:01.578265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58404af-dc54-4213-8bbf-c1082f2cefe5 None admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:01.578550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58404af-dc54-4213-8bbf-c1082f2cefe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:01.578826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58404af-dc54-4213-8bbf-c1082f2cefe5 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:01.579551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58404af-dc54-4213-8bbf-c1082f2cefe5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:01.581025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58404af-dc54-4213-8bbf-c1082f2cefe5 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:01.696837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 650/1295] 10.222.0.41 () {60 vars in 1141 bytes} [Thu May 26 12:28:01 2022] POST /identity/v3/services => generated 246 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:28:03.899208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de928-5967-4f1f-9687-ff8bea173ee7 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:03.899767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de928-5967-4f1f-9687-ff8bea173ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:03.899767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de928-5967-4f1f-9687-ff8bea173ee7 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:03.901173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 646/1296] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:03.906612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d142fd5-7bcf-48b0-ac8a-5719c673d08d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:03.907044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d142fd5-7bcf-48b0-ac8a-5719c673d08d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:03.907165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d142fd5-7bcf-48b0-ac8a-5719c673d08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:03.923913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4d142fd5-7bcf-48b0-ac8a-5719c673d08d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:03.925118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4d142fd5-7bcf-48b0-ac8a-5719c673d08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:03.996298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 651/1297] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:28:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:28:04.018779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de928-5967-4f1f-9687-ff8bea173ee7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:04.116595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de928-5967-4f1f-9687-ff8bea173ee7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:04.150198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9700670-9709-4770-ac43-5a0822982a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:04.150957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9700670-9709-4770-ac43-5a0822982a53 None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:04.151239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9700670-9709-4770-ac43-5a0822982a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:04.151510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9700670-9709-4770-ac43-5a0822982a53 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:04.152172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9700670-9709-4770-ac43-5a0822982a53 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:04.153524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9700670-9709-4770-ac43-5a0822982a53 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-b9700670-9709-4770-ac43-5a0822982a53 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:04.164924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:04.166140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:28:04.167190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 647/1298] 10.222.0.41 () {56 vars in 1117 bytes} [Thu May 26 12:28:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:04.172313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d142fd5-7bcf-48b0-ac8a-5719c673d08d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:04.191075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:04.269479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d142fd5-7bcf-48b0-ac8a-5719c673d08d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:04.306355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28e76e-b185-4c82-95ec-1f221b2048f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:04.307558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28e76e-b185-4c82-95ec-1f221b2048f2 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:04.307852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28e76e-b185-4c82-95ec-1f221b2048f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:04.308134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28e76e-b185-4c82-95ec-1f221b2048f2 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:04.308865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28e76e-b185-4c82-95ec-1f221b2048f2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:04.309179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28e76e-b185-4c82-95ec-1f221b2048f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:04.310588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28e76e-b185-4c82-95ec-1f221b2048f2 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:04.315602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 652/1299] 10.222.0.41 () {56 vars in 1116 bytes} [Thu May 26 12:28:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:04.321613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9700670-9709-4770-ac43-5a0822982a53 None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:04.352233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:04.417404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9700670-9709-4770-ac43-5a0822982a53 None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:04.450105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c1ded-239d-4280-8bf1-d0a68b78b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:04.450970 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c1ded-239d-4280-8bf1-d0a68b78b87a None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:04.451829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c1ded-239d-4280-8bf1-d0a68b78b87a None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:04.452111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c1ded-239d-4280-8bf1-d0a68b78b87a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:04.452898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c1ded-239d-4280-8bf1-d0a68b78b87a None admin] RBAC: Adding query filter params (interface=public, service_id=e040b9ed5fc740aebeb1bb9c9d0d482c, region_id=RegionOne) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:04.453215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c1ded-239d-4280-8bf1-d0a68b78b87a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:04.454645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c1ded-239d-4280-8bf1-d0a68b78b87a None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:04.459568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 648/1300] 10.222.0.41 () {56 vars in 1251 bytes} [Thu May 26 12:28:04 2022] GET /identity/v3/endpoints?service_id=e040b9ed5fc740aebeb1bb9c9d0d482c&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:04.465154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28e76e-b185-4c82-95ec-1f221b2048f2 None admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:04.545187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:04.562957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28e76e-b185-4c82-95ec-1f221b2048f2 None admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:04.595738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ca09b-e66e-48a4-8318-c81e2c2b0a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:04.596393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca09b-e66e-48a4-8318-c81e2c2b0a05 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:04.596682 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca09b-e66e-48a4-8318-c81e2c2b0a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:04.596965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca09b-e66e-48a4-8318-c81e2c2b0a05 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:04.597640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ca09b-e66e-48a4-8318-c81e2c2b0a05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:04.599040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ca09b-e66e-48a4-8318-c81e2c2b0a05 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:04.606163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 653/1301] 10.222.0.41 () {56 vars in 1087 bytes} [Thu May 26 12:28:04 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:28:06.780989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b073d-ffff-4613-8e80-697e4aa32e9a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:06.781513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b073d-ffff-4613-8e80-697e4aa32e9a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:06.781605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b073d-ffff-4613-8e80-697e4aa32e9a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:06.782944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 649/1302] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:06.788055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b5bb4-2c1b-4d5e-8f12-27e3ae219438 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:06.788477 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b5bb4-2c1b-4d5e-8f12-27e3ae219438 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:06.788619 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b5bb4-2c1b-4d5e-8f12-27e3ae219438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:06.805009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e24b5bb4-2c1b-4d5e-8f12-27e3ae219438 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:06.806259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e24b5bb4-2c1b-4d5e-8f12-27e3ae219438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:06.871763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 654/1303] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:28:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:28:06.893743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b073d-ffff-4613-8e80-697e4aa32e9a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:06.988969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:06.995769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b073d-ffff-4613-8e80-697e4aa32e9a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:07.030738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0f287-a599-4ee8-a63a-6e9ae714ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:07.031596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0f287-a599-4ee8-a63a-6e9ae714ec7b None admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:07.031804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0f287-a599-4ee8-a63a-6e9ae714ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:07.032135 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0f287-a599-4ee8-a63a-6e9ae714ec7b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:07.032777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0f287-a599-4ee8-a63a-6e9ae714ec7b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:07.034185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0f287-a599-4ee8-a63a-6e9ae714ec7b None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application [None req-6ed0f287-a599-4ee8-a63a-6e9ae714ec7b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:28:07.046655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:28:07.055861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application with Lock( May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self._enter() May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application return self.creator() May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application created_value = creator( May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: ERROR keystone.server.flask.application May 26 12:28:07.057044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 650/1304] 10.222.0.41 () {56 vars in 1117 bytes} [Thu May 26 12:28:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:28:07.057971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b5bb4-2c1b-4d5e-8f12-27e3ae219438 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:07.131196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:07.153006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b5bb4-2c1b-4d5e-8f12-27e3ae219438 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:07.184951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec7ca2f-2303-4443-8a40-aa9465648719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:07.185608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7ca2f-2303-4443-8a40-aa9465648719 None admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:07.185921 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7ca2f-2303-4443-8a40-aa9465648719 None admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:07.186204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec7ca2f-2303-4443-8a40-aa9465648719 None admin] PATH_INFO: `/v3/services` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:07.186907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7ca2f-2303-4443-8a40-aa9465648719 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:28:07.187218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7ca2f-2303-4443-8a40-aa9465648719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:07.188611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec7ca2f-2303-4443-8a40-aa9465648719 None admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:07.193569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 655/1305] 10.222.0.41 () {56 vars in 1116 bytes} [Thu May 26 12:28:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:28:07.199461 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0f287-a599-4ee8-a63a-6e9ae714ec7b None admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:07.297348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0f287-a599-4ee8-a63a-6e9ae714ec7b None admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:07.329966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414a1fb-eb2e-42b7-bf19-98f84d3ee3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:07.330613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414a1fb-eb2e-42b7-bf19-98f84d3ee3d2 None admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:07.330906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414a1fb-eb2e-42b7-bf19-98f84d3ee3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:07.331190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414a1fb-eb2e-42b7-bf19-98f84d3ee3d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:07.331939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414a1fb-eb2e-42b7-bf19-98f84d3ee3d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:07.333301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414a1fb-eb2e-42b7-bf19-98f84d3ee3d2 None admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:28:07.451239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 651/1306] 10.222.0.41 () {60 vars in 1144 bytes} [Thu May 26 12:28:07 2022] POST /identity/v3/endpoints => generated 331 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:28:17.267691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=30 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:17.446013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:10.144197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f63535-8e43-4eb0-9cf9-256de8624373 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.145651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f63535-8e43-4eb0-9cf9-256de8624373 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.145651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f63535-8e43-4eb0-9cf9-256de8624373 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.153146 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0097855-6e76-4b42-8edd-1b5889c002b9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.153722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0097855-6e76-4b42-8edd-1b5889c002b9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.153722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0097855-6e76-4b42-8edd-1b5889c002b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.157536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 656/1307] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:10.264310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c0097855-6e76-4b42-8edd-1b5889c002b9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:10.265552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c0097855-6e76-4b42-8edd-1b5889c002b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:10.398174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 652/1308] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:10.446565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82b1e0-7a25-4b52-8627-853caec4f516 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.447218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82b1e0-7a25-4b52-8627-853caec4f516 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.447904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82b1e0-7a25-4b52-8627-853caec4f516 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.449449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 657/1309] 10.222.0.41 () {54 vars in 964 bytes} [Thu May 26 12:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:10.455930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23897b-5dd0-45de-8d48-ab5052a5426c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:10.456530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23897b-5dd0-45de-8d48-ab5052a5426c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:10.457023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23897b-5dd0-45de-8d48-ab5052a5426c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:10.641637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1c23897b-5dd0-45de-8d48-ab5052a5426c None None] MFA Rules not processed for user `d7a0dbcea7ef4cdd9134f4c5a9cf5fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:10.643030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1c23897b-5dd0-45de-8d48-ab5052a5426c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:10.701501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:10.829554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 653/1310] 10.222.0.41 () {58 vars in 1061 bytes} [Thu May 26 12:36:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:10.831584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82b1e0-7a25-4b52-8627-853caec4f516 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:10.837963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4e82b1e0-7a25-4b52-8627-853caec4f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:11.131760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82b1e0-7a25-4b52-8627-853caec4f516 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:11.223909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c4c73-cb17-4e5c-8894-398175120e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:11.226232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c4c73-cb17-4e5c-8894-398175120e4b service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:11.226944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c4c73-cb17-4e5c-8894-398175120e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:11.227663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c4c73-cb17-4e5c-8894-398175120e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:11.231183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-737c4c73-cb17-4e5c-8894-398175120e4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:11.330637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:11.421565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c4c73-cb17-4e5c-8894-398175120e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:11.423373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c4c73-cb17-4e5c-8894-398175120e4b service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:11.444573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 658/1311] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:36:14.242868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837304d-6235-4c21-911b-050a4acbad9a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.243394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837304d-6235-4c21-911b-050a4acbad9a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.243485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837304d-6235-4c21-911b-050a4acbad9a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.244806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 654/1312] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:14.250291 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851f037-419f-4094-996a-3daaca6d541f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.250816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851f037-419f-4094-996a-3daaca6d541f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.250910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2851f037-419f-4094-996a-3daaca6d541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.328441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2851f037-419f-4094-996a-3daaca6d541f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:14.329741 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2851f037-419f-4094-996a-3daaca6d541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.426768 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 659/1313] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:14.464698 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837304d-6235-4c21-911b-050a4acbad9a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:14.466450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5837304d-6235-4c21-911b-050a4acbad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.571426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837304d-6235-4c21-911b-050a4acbad9a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:14.641895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:14.644609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e39b0-491c-48fa-9650-4f71ef247ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:14.646031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e39b0-491c-48fa-9650-4f71ef247ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:14.646319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e39b0-491c-48fa-9650-4f71ef247ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:14.646599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e39b0-491c-48fa-9650-4f71ef247ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:14.648291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-202e39b0-491c-48fa-9650-4f71ef247ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:14.760251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e39b0-491c-48fa-9650-4f71ef247ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:14.761717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e39b0-491c-48fa-9650-4f71ef247ea7 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:14.781221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 655/1314] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:17.570806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ce70-f38e-4467-9696-0e074f0b6a99 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.571396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ce70-f38e-4467-9696-0e074f0b6a99 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.571396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111ce70-f38e-4467-9696-0e074f0b6a99 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.572726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 660/1315] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:17.578161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b8e1-bbec-4729-9c29-f991e954b932 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:17.578804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b8e1-bbec-4729-9c29-f991e954b932 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:17.578804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b8e1-bbec-4729-9c29-f991e954b932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:17.647506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1d13b8e1-bbec-4729-9c29-f991e954b932 None None] MFA Rules not processed for user `41d518da297c4aae97a3c4c58f295974`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:17.648752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1d13b8e1-bbec-4729-9c29-f991e954b932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:17.704377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:17.750165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 656/1316] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:17.790155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111ce70-f38e-4467-9696-0e074f0b6a99 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:17.791699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6111ce70-f38e-4467-9696-0e074f0b6a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:17.803655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:17.920078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111ce70-f38e-4467-9696-0e074f0b6a99 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:18.006417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d43a5-5e15-474b-965d-86b24737ad57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:18.007064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d43a5-5e15-474b-965d-86b24737ad57 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:18.007343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d43a5-5e15-474b-965d-86b24737ad57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:18.007615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d43a5-5e15-474b-965d-86b24737ad57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:18.009351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f12d43a5-5e15-474b-965d-86b24737ad57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:18.089467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:18.148477 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d43a5-5e15-474b-965d-86b24737ad57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:18.149970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d43a5-5e15-474b-965d-86b24737ad57 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:18.170001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 661/1317] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:36:21.530607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c150f6-60ce-4a80-ba2b-797b5b97e1a2 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:21.531198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c150f6-60ce-4a80-ba2b-797b5b97e1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:21.531198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c150f6-60ce-4a80-ba2b-797b5b97e1a2 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:21.532662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 657/1318] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:21.539118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacde1f-0e7a-4b21-bf0a-0813cd8bd0aa None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:21.539612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacde1f-0e7a-4b21-bf0a-0813cd8bd0aa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:21.539729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacde1f-0e7a-4b21-bf0a-0813cd8bd0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:21.633611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-afacde1f-0e7a-4b21-bf0a-0813cd8bd0aa None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:21.634901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-afacde1f-0e7a-4b21-bf0a-0813cd8bd0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:21.771176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 662/1319] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:21.836787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402c66-1548-4806-a54d-9e3c51b1b2db None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:21.837083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402c66-1548-4806-a54d-9e3c51b1b2db None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:21.837376 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c402c66-1548-4806-a54d-9e3c51b1b2db None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:21.838842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 658/1320] 10.222.0.41 () {54 vars in 964 bytes} [Thu May 26 12:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:21.848905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7dcc8-34c3-4990-af61-2320de5af83b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:21.849388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7dcc8-34c3-4990-af61-2320de5af83b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:21.849911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7dcc8-34c3-4990-af61-2320de5af83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:21.886945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:21.954368 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3ab7dcc8-34c3-4990-af61-2320de5af83b None None] MFA Rules not processed for user `d7a0dbcea7ef4cdd9134f4c5a9cf5fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:21.956149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3ab7dcc8-34c3-4990-af61-2320de5af83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:22.043132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 663/1321] 10.222.0.41 () {58 vars in 1061 bytes} [Thu May 26 12:36:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:22.053155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402c66-1548-4806-a54d-9e3c51b1b2db None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:22.055589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8c402c66-1548-4806-a54d-9e3c51b1b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:22.183590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c402c66-1548-4806-a54d-9e3c51b1b2db None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:22.268502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd19a27-4f75-4d86-8199-a4d0bd84b4dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:22.268984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19a27-4f75-4d86-8199-a4d0bd84b4dc service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:22.269274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19a27-4f75-4d86-8199-a4d0bd84b4dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:22.269556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd19a27-4f75-4d86-8199-a4d0bd84b4dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:22.271360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4cd19a27-4f75-4d86-8199-a4d0bd84b4dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:22.279907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:22.395937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd19a27-4f75-4d86-8199-a4d0bd84b4dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:22.397611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd19a27-4f75-4d86-8199-a4d0bd84b4dc service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:22.418188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 659/1322] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:26.608611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb183228-50d7-4323-b244-3b396de7ce40 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:26.609160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb183228-50d7-4323-b244-3b396de7ce40 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:26.609160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb183228-50d7-4323-b244-3b396de7ce40 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:26.610831 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 664/1323] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:26.616940 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0f884-8ae4-4167-9235-5390c0b689a6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:26.617592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0f884-8ae4-4167-9235-5390c0b689a6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:26.617592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0f884-8ae4-4167-9235-5390c0b689a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:26.700686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c1d0f884-8ae4-4167-9235-5390c0b689a6 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:26.701942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c1d0f884-8ae4-4167-9235-5390c0b689a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:26.790555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:26.848599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 660/1324] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:26.887156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb183228-50d7-4323-b244-3b396de7ce40 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:26.889242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cb183228-50d7-4323-b244-3b396de7ce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:27.030503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb183228-50d7-4323-b244-3b396de7ce40 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:27.044116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:27.136753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeea2b2-1825-46e7-93dc-e1c33b2eed3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:27.137392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeea2b2-1825-46e7-93dc-e1c33b2eed3e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:27.137859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeea2b2-1825-46e7-93dc-e1c33b2eed3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:27.138152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeea2b2-1825-46e7-93dc-e1c33b2eed3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:27.140793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2eeea2b2-1825-46e7-93dc-e1c33b2eed3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:27.305296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeea2b2-1825-46e7-93dc-e1c33b2eed3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:27.306795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeea2b2-1825-46e7-93dc-e1c33b2eed3e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:27.328209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 665/1325] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:36:29.712087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147cfd-0d99-4db6-8444-4eb6738a5e5b None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:29.712640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147cfd-0d99-4db6-8444-4eb6738a5e5b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:29.712997 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59147cfd-0d99-4db6-8444-4eb6738a5e5b None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:29.715494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 661/1326] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:29.721900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548517a-8910-4219-9f40-103fc936b7f0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:29.722386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548517a-8910-4219-9f40-103fc936b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:29.722700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0548517a-8910-4219-9f40-103fc936b7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:29.793997 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:29.829059 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0548517a-8910-4219-9f40-103fc936b7f0 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:29.831112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0548517a-8910-4219-9f40-103fc936b7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:29.966471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 666/1327] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:30.002811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147cfd-0d99-4db6-8444-4eb6738a5e5b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:30.004451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-59147cfd-0d99-4db6-8444-4eb6738a5e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:30.113993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59147cfd-0d99-4db6-8444-4eb6738a5e5b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:30.190002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ef7bc-2d1b-4728-b9f9-8b1e6eaf333d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:30.190667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef7bc-2d1b-4728-b9f9-8b1e6eaf333d service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:30.190954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef7bc-2d1b-4728-b9f9-8b1e6eaf333d service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:30.191237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ef7bc-2d1b-4728-b9f9-8b1e6eaf333d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:30.193038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-332ef7bc-2d1b-4728-b9f9-8b1e6eaf333d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:30.209778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:30.306657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ef7bc-2d1b-4728-b9f9-8b1e6eaf333d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:30.308097 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ef7bc-2d1b-4728-b9f9-8b1e6eaf333d service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:30.326725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 662/1328] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:32.669031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449acbb9-8030-48a9-8554-db001d53731f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:32.669601 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449acbb9-8030-48a9-8554-db001d53731f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:32.669894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449acbb9-8030-48a9-8554-db001d53731f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:32.671339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 667/1329] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:32.677566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554b01-5d9b-4511-b2ed-18199a324e42 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:32.678029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554b01-5d9b-4511-b2ed-18199a324e42 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:32.678162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2554b01-5d9b-4511-b2ed-18199a324e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:32.744475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a2554b01-5d9b-4511-b2ed-18199a324e42 None None] MFA Rules not processed for user `41d518da297c4aae97a3c4c58f295974`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:32.745718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a2554b01-5d9b-4511-b2ed-18199a324e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:32.822863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:32.863015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 663/1330] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:32.900571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449acbb9-8030-48a9-8554-db001d53731f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:32.902252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-449acbb9-8030-48a9-8554-db001d53731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:33.030796 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449acbb9-8030-48a9-8554-db001d53731f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:33.058841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:33.130743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835e8df-b20e-4f5e-a0c7-2f41a5d72832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:33.131404 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e8df-b20e-4f5e-a0c7-2f41a5d72832 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:33.131689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e8df-b20e-4f5e-a0c7-2f41a5d72832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:33.131972 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835e8df-b20e-4f5e-a0c7-2f41a5d72832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:33.133726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1835e8df-b20e-4f5e-a0c7-2f41a5d72832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:33.424206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835e8df-b20e-4f5e-a0c7-2f41a5d72832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:33.424206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835e8df-b20e-4f5e-a0c7-2f41a5d72832 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:33.424206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 668/1331] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:36.279216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb75d-738b-42d6-9012-599138673733 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:36.279915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb75d-738b-42d6-9012-599138673733 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:36.279915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb75d-738b-42d6-9012-599138673733 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:36.280955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 664/1332] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:36.287672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467de017-14a4-4e42-adba-739f214c9282 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:36.288149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467de017-14a4-4e42-adba-739f214c9282 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:36.288413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467de017-14a4-4e42-adba-739f214c9282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:36.377786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:36.380908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-467de017-14a4-4e42-adba-739f214c9282 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:36.382225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-467de017-14a4-4e42-adba-739f214c9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:36.500927 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 669/1333] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:36.536961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccb75d-738b-42d6-9012-599138673733 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:36.538547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e2ccb75d-738b-42d6-9012-599138673733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:36.673015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccb75d-738b-42d6-9012-599138673733 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:36.781564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfed1ee-b3de-47e5-81b0-aa9a2d968559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:36.782319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfed1ee-b3de-47e5-81b0-aa9a2d968559 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:36.782628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfed1ee-b3de-47e5-81b0-aa9a2d968559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:36.782914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfed1ee-b3de-47e5-81b0-aa9a2d968559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:36.784699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6dfed1ee-b3de-47e5-81b0-aa9a2d968559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:36.824440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:36.954343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfed1ee-b3de-47e5-81b0-aa9a2d968559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:36.957277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfed1ee-b3de-47e5-81b0-aa9a2d968559 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:36.981091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 665/1334] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:36:39.475066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e5398-33ce-4170-be49-83db0307a984 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:39.475700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e5398-33ce-4170-be49-83db0307a984 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:39.475700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e5398-33ce-4170-be49-83db0307a984 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:39.477020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 670/1335] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:39.482780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ed46-e0ce-431c-af5e-c97b744fa030 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:39.483346 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ed46-e0ce-431c-af5e-c97b744fa030 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:39.483346 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025ed46-e0ce-431c-af5e-c97b744fa030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:39.574040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3025ed46-e0ce-431c-af5e-c97b744fa030 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:39.575485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3025ed46-e0ce-431c-af5e-c97b744fa030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:39.664930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:39.693399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 666/1336] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:36:39.734404 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e5398-33ce-4170-be49-83db0307a984 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:39.736245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c14e5398-33ce-4170-be49-83db0307a984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:39.875090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e5398-33ce-4170-be49-83db0307a984 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:39.906717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:39.961533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6b4715-727a-4fed-8df7-fbf2d0c39e84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:39.961940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b4715-727a-4fed-8df7-fbf2d0c39e84 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:39.962229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b4715-727a-4fed-8df7-fbf2d0c39e84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:39.962679 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6b4715-727a-4fed-8df7-fbf2d0c39e84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:39.964218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cc6b4715-727a-4fed-8df7-fbf2d0c39e84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:40.101203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b4715-727a-4fed-8df7-fbf2d0c39e84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:40.102693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6b4715-727a-4fed-8df7-fbf2d0c39e84 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:40.124207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 671/1337] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:43.744355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0a7da-8346-432a-8813-e057a0286549 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:43.745054 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0a7da-8346-432a-8813-e057a0286549 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:43.745353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0a7da-8346-432a-8813-e057a0286549 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:43.747132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 667/1338] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:43.752834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61cae1-9299-4b36-84fc-f17a7100539d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:43.753312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61cae1-9299-4b36-84fc-f17a7100539d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:43.753432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61cae1-9299-4b36-84fc-f17a7100539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:43.842660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5a61cae1-9299-4b36-84fc-f17a7100539d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:43.843923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5a61cae1-9299-4b36-84fc-f17a7100539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:43.854995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:36:43.983629 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 672/1339] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:44.026492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0a7da-8346-432a-8813-e057a0286549 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:44.028777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6ec0a7da-8346-432a-8813-e057a0286549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:44.171649 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0a7da-8346-432a-8813-e057a0286549 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:44.175948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2d6e3-1bc5-4635-9803-71aad7884cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:44.176636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d6e3-1bc5-4635-9803-71aad7884cdb service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:44.177918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d6e3-1bc5-4635-9803-71aad7884cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:44.177918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2d6e3-1bc5-4635-9803-71aad7884cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:44.187652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2d6e3-1bc5-4635-9803-71aad7884cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:44.189099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2d6e3-1bc5-4635-9803-71aad7884cdb service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:44.199629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 668/1340] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:49.705283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35edac-a802-4dd7-ab84-debea26f56d3 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:49.705953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35edac-a802-4dd7-ab84-debea26f56d3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:49.706052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35edac-a802-4dd7-ab84-debea26f56d3 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:49.708867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 673/1341] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:49.717260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506ad7b-c5b2-44f2-a615-d8385d15f1b4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:49.718059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506ad7b-c5b2-44f2-a615-d8385d15f1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:49.718278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506ad7b-c5b2-44f2-a615-d8385d15f1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:49.763854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d506ad7b-c5b2-44f2-a615-d8385d15f1b4 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:49.765417 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d506ad7b-c5b2-44f2-a615-d8385d15f1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:49.898477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 669/1342] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:49.944910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35edac-a802-4dd7-ab84-debea26f56d3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:49.964298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b35edac-a802-4dd7-ab84-debea26f56d3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:49.968802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcbae5-a6ca-4d22-85dd-2ab3beed3a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:49.969862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbae5-a6ca-4d22-85dd-2ab3beed3a2e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:49.970394 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbae5-a6ca-4d22-85dd-2ab3beed3a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:49.970844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcbae5-a6ca-4d22-85dd-2ab3beed3a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:49.982154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcbae5-a6ca-4d22-85dd-2ab3beed3a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:49.984092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcbae5-a6ca-4d22-85dd-2ab3beed3a2e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:50.002295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 674/1343] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:36:53.716238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d51513-aa5b-48eb-94e4-94ad192f0e0e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:53.716929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d51513-aa5b-48eb-94e4-94ad192f0e0e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:53.717246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d51513-aa5b-48eb-94e4-94ad192f0e0e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:53.719877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 670/1344] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:53.728058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b4f32-0ab0-485d-80e7-dde7a888b702 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:53.728608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b4f32-0ab0-485d-80e7-dde7a888b702 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:53.728776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b4f32-0ab0-485d-80e7-dde7a888b702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:53.748623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-330b4f32-0ab0-485d-80e7-dde7a888b702 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:53.749894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-330b4f32-0ab0-485d-80e7-dde7a888b702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:53.759065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 675/1345] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:53.800273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d51513-aa5b-48eb-94e4-94ad192f0e0e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:53.802849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-69d51513-aa5b-48eb-94e4-94ad192f0e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:53.823577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d51513-aa5b-48eb-94e4-94ad192f0e0e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:53.829216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd43768-324c-4307-bf4f-05c32e70b163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:53.830393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43768-324c-4307-bf4f-05c32e70b163 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:53.830883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43768-324c-4307-bf4f-05c32e70b163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:53.831366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd43768-324c-4307-bf4f-05c32e70b163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:53.846842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd43768-324c-4307-bf4f-05c32e70b163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:53.848562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd43768-324c-4307-bf4f-05c32e70b163 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:53.860665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 671/1346] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:36:58.935313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef94eb-d19a-485b-b523-614e98b30fbb None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:58.935880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef94eb-d19a-485b-b523-614e98b30fbb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:58.935880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef94eb-d19a-485b-b523-614e98b30fbb None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:58.937219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 676/1347] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:36:58.943230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93f9c6-c8d8-4df6-b810-8bbd7be784a9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:58.943757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93f9c6-c8d8-4df6-b810-8bbd7be784a9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:58.943992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93f9c6-c8d8-4df6-b810-8bbd7be784a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:58.962764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ab93f9c6-c8d8-4df6-b810-8bbd7be784a9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:36:58.964224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ab93f9c6-c8d8-4df6-b810-8bbd7be784a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:36:58.972253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 672/1348] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:36:59.011833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef94eb-d19a-485b-b523-614e98b30fbb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:36:59.024228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef94eb-d19a-485b-b523-614e98b30fbb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:36:59.027865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f5dab-9e4e-4e56-9aba-01a2cd16dc8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:36:59.028522 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f5dab-9e4e-4e56-9aba-01a2cd16dc8e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:36:59.028807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f5dab-9e4e-4e56-9aba-01a2cd16dc8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:36:59.029086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f5dab-9e4e-4e56-9aba-01a2cd16dc8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:36:59.039367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f5dab-9e4e-4e56-9aba-01a2cd16dc8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:36:59.040813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f5dab-9e4e-4e56-9aba-01a2cd16dc8e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:36:59.052203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 677/1349] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:04.841618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080871c-b43a-4210-9419-15270007b600 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:04.841618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080871c-b43a-4210-9419-15270007b600 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:04.841618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080871c-b43a-4210-9419-15270007b600 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:04.847921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 673/1350] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:37:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:04.855191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810873-3ab1-4faf-9ac7-f97eac11434d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:04.856096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810873-3ab1-4faf-9ac7-f97eac11434d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:04.856651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01810873-3ab1-4faf-9ac7-f97eac11434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:05.002391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-01810873-3ab1-4faf-9ac7-f97eac11434d None None] MFA Rules not processed for user `0412209ee10a46558a8baf10b59f89a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:05.004665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-01810873-3ab1-4faf-9ac7-f97eac11434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:05.067744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:05.119554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 678/1351] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:37:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:08.958547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:09.947332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c7b8-2dca-49f8-b3ca-2ff310de6571 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:09.948179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c7b8-2dca-49f8-b3ca-2ff310de6571 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:09.948691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421c7b8-2dca-49f8-b3ca-2ff310de6571 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:09.950717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 674/1352] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:37:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:09.958308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4bd0b-2b25-4df2-af36-d52595f015ba None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:09.958811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4bd0b-2b25-4df2-af36-d52595f015ba None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:09.959089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4bd0b-2b25-4df2-af36-d52595f015ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:09.978763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-92c4bd0b-2b25-4df2-af36-d52595f015ba None None] MFA Rules not processed for user `0412209ee10a46558a8baf10b59f89a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:09.979977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-92c4bd0b-2b25-4df2-af36-d52595f015ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:09.990032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 679/1353] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:37:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:11.842664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5235-0a1b-485a-9284-f415b76aed93 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:11.843198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5235-0a1b-485a-9284-f415b76aed93 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:11.843198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5235-0a1b-485a-9284-f415b76aed93 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:11.844727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 675/1354] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:11.850710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10365-157b-4d75-9ef5-a8c2a315c13e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:11.851224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10365-157b-4d75-9ef5-a8c2a315c13e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:11.851312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a10365-157b-4d75-9ef5-a8c2a315c13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:11.877859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e9a10365-157b-4d75-9ef5-a8c2a315c13e None None] MFA Rules not processed for user `0412209ee10a46558a8baf10b59f89a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:11.879509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e9a10365-157b-4d75-9ef5-a8c2a315c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:11.889890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 680/1355] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:37:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:15.713025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3967d-76ca-4815-921d-14f6a2bbf45e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:15.713643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3967d-76ca-4815-921d-14f6a2bbf45e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:15.713643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3967d-76ca-4815-921d-14f6a2bbf45e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:15.714939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 676/1356] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:15.720521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1d249-373d-4179-ad42-794683fe4cb9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:15.721007 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1d249-373d-4179-ad42-794683fe4cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:15.721119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1d249-373d-4179-ad42-794683fe4cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:15.746867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-55a1d249-373d-4179-ad42-794683fe4cb9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:15.746867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-55a1d249-373d-4179-ad42-794683fe4cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:15.755581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 681/1357] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:15.813642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4f465-e0d5-4016-b153-1bbaafd6ad0f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:15.814344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4f465-e0d5-4016-b153-1bbaafd6ad0f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:15.814948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4f465-e0d5-4016-b153-1bbaafd6ad0f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:15.818412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 677/1358] 10.222.0.41 () {54 vars in 961 bytes} [Thu May 26 12:37:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:15.826545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f959f-7270-45c6-98a2-08926915ebab None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:15.826837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f959f-7270-45c6-98a2-08926915ebab None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:15.827127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f959f-7270-45c6-98a2-08926915ebab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:15.900817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-424f959f-7270-45c6-98a2-08926915ebab None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:15.903395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-424f959f-7270-45c6-98a2-08926915ebab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:16.020843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 682/1359] 10.222.0.41 () {58 vars in 1058 bytes} [Thu May 26 12:37:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:16.028337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4f465-e0d5-4016-b153-1bbaafd6ad0f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:16.043180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f4f465-e0d5-4016-b153-1bbaafd6ad0f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:16.048810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f065217-61e0-4cd2-888d-192ca56cc4a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:16.052357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065217-61e0-4cd2-888d-192ca56cc4a7 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:16.052357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065217-61e0-4cd2-888d-192ca56cc4a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:16.052357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f065217-61e0-4cd2-888d-192ca56cc4a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:16.060873 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f065217-61e0-4cd2-888d-192ca56cc4a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:16.062601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f065217-61e0-4cd2-888d-192ca56cc4a7 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:16.085892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 678/1360] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:18.630503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e718b3-b17d-4f0d-9506-1003d5cd107f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:18.631043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e718b3-b17d-4f0d-9506-1003d5cd107f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:18.631043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e718b3-b17d-4f0d-9506-1003d5cd107f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:18.632781 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 683/1361] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:18.638390 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf3df-5b0a-48df-b959-d2107b1cab6d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:18.639286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf3df-5b0a-48df-b959-d2107b1cab6d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:18.639744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbf3df-5b0a-48df-b959-d2107b1cab6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:18.662342 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b8cbf3df-5b0a-48df-b959-d2107b1cab6d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:18.663853 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b8cbf3df-5b0a-48df-b959-d2107b1cab6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:18.672567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 679/1362] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:37:18.718121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e718b3-b17d-4f0d-9506-1003d5cd107f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:18.735624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e718b3-b17d-4f0d-9506-1003d5cd107f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:18.741452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d1393-16a3-45b0-985e-69a0b932c6a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:18.742156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1393-16a3-45b0-985e-69a0b932c6a8 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:18.742580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1393-16a3-45b0-985e-69a0b932c6a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:18.742872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1393-16a3-45b0-985e-69a0b932c6a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:18.752832 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d1393-16a3-45b0-985e-69a0b932c6a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:18.754649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d1393-16a3-45b0-985e-69a0b932c6a8 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:18.766340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 684/1363] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:21.899703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e4fe1-ec69-446d-a41b-43831db94448 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:21.900215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e4fe1-ec69-446d-a41b-43831db94448 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:21.900335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e4fe1-ec69-446d-a41b-43831db94448 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:21.901635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 680/1364] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:21.906973 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d73e2-0205-44da-ae84-a4e5c9465c78 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:21.907389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d73e2-0205-44da-ae84-a4e5c9465c78 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:21.907545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d73e2-0205-44da-ae84-a4e5c9465c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:21.927578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8b7d73e2-0205-44da-ae84-a4e5c9465c78 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:21.928803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8b7d73e2-0205-44da-ae84-a4e5c9465c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:21.937301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 685/1365] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:37:21.991933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1959-42ab-4c47-9963-4ef54c7193eb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:21.993318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1959-42ab-4c47-9963-4ef54c7193eb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:21.993703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a1959-42ab-4c47-9963-4ef54c7193eb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:21.996158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 681/1366] 10.222.0.41 () {54 vars in 961 bytes} [Thu May 26 12:37:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:22.002760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65775f-c7b7-48ac-889e-d86e8784afd1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:22.004804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65775f-c7b7-48ac-889e-d86e8784afd1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:22.004804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65775f-c7b7-48ac-889e-d86e8784afd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:22.027957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ed65775f-c7b7-48ac-889e-d86e8784afd1 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:22.030156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ed65775f-c7b7-48ac-889e-d86e8784afd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:22.041878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 686/1367] 10.222.0.41 () {58 vars in 1058 bytes} [Thu May 26 12:37:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:22.051149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a1959-42ab-4c47-9963-4ef54c7193eb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:22.069045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a1959-42ab-4c47-9963-4ef54c7193eb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:22.084252 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe28ebcb-eded-4161-b521-27c35fa009bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:22.084998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28ebcb-eded-4161-b521-27c35fa009bd service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:22.085736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28ebcb-eded-4161-b521-27c35fa009bd service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:22.086222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe28ebcb-eded-4161-b521-27c35fa009bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:22.097842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28ebcb-eded-4161-b521-27c35fa009bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:22.100879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe28ebcb-eded-4161-b521-27c35fa009bd service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:22.114232 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 682/1368] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:37:24.393445 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72084d47-f5a6-4584-b0ba-05704a2e4bde None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:24.394143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72084d47-f5a6-4584-b0ba-05704a2e4bde None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:24.394143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72084d47-f5a6-4584-b0ba-05704a2e4bde None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:24.395768 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 687/1369] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:24.403197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d4d12-a478-4e49-b139-96959eb1fddc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:24.403197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d4d12-a478-4e49-b139-96959eb1fddc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:24.403197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d4d12-a478-4e49-b139-96959eb1fddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:24.430167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d13d4d12-a478-4e49-b139-96959eb1fddc None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:24.431633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d13d4d12-a478-4e49-b139-96959eb1fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:24.440762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 683/1370] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:24.754376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa0a9-9911-4229-ab25-8c24bb49b59a None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:24.754376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa0a9-9911-4229-ab25-8c24bb49b59a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:24.754376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa0a9-9911-4229-ab25-8c24bb49b59a None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:24.762813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 688/1371] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:24.764056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea010979-09ab-4766-9652-ac405a2a6303 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:24.764056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea010979-09ab-4766-9652-ac405a2a6303 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:24.764056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea010979-09ab-4766-9652-ac405a2a6303 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:24.765423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04284656-adf8-4912-9a40-ab06189d6f45 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:24.765423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04284656-adf8-4912-9a40-ab06189d6f45 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:24.765423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04284656-adf8-4912-9a40-ab06189d6f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:24.767356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 684/1372] 10.222.0.41 () {54 vars in 963 bytes} [Thu May 26 12:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:24.771897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fa030-8f75-4d4e-a1f8-8a6b90afe8f4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:24.772591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fa030-8f75-4d4e-a1f8-8a6b90afe8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:24.772591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988fa030-8f75-4d4e-a1f8-8a6b90afe8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:24.786155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-04284656-adf8-4912-9a40-ab06189d6f45 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:24.787754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-04284656-adf8-4912-9a40-ab06189d6f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:24.802198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 689/1373] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:24.848276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-988fa030-8f75-4d4e-a1f8-8a6b90afe8f4 None None] MFA Rules not processed for user `395e7e721bf349f2bee876a23fc12291`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:24.849511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-988fa030-8f75-4d4e-a1f8-8a6b90afe8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:24.851348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04284656-adf8-4912-9a40-ab06189d6f45 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:24.865440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04284656-adf8-4912-9a40-ab06189d6f45 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:24.871295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2fc34-613b-4261-9238-4721f2465a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:24.871966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2fc34-613b-4261-9238-4721f2465a25 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:24.872259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2fc34-613b-4261-9238-4721f2465a25 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:24.872541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2fc34-613b-4261-9238-4721f2465a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:24.885388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2fc34-613b-4261-9238-4721f2465a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:24.887943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2fc34-613b-4261-9238-4721f2465a25 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:24.900526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 690/1374] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:37:24.933093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 685/1375] 10.222.0.41 () {58 vars in 1060 bytes} [Thu May 26 12:37:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:24.942354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2fc34-613b-4261-9238-4721f2465a25 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:24.956300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2fc34-613b-4261-9238-4721f2465a25 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:24.961306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15707b-db42-46a2-a2e4-d57f42f625f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:24.962052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15707b-db42-46a2-a2e4-d57f42f625f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:24.962351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15707b-db42-46a2-a2e4-d57f42f625f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:24.962632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15707b-db42-46a2-a2e4-d57f42f625f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:24.973786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15707b-db42-46a2-a2e4-d57f42f625f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:24.975371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15707b-db42-46a2-a2e4-d57f42f625f4 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:24.988073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 691/1376] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:27.503039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c118e3-4e0f-4be2-a504-0e11c7d22ce1 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:27.503584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c118e3-4e0f-4be2-a504-0e11c7d22ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:27.503699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c118e3-4e0f-4be2-a504-0e11c7d22ce1 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:27.505436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 686/1377] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:27.511981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a210-4fe0-445d-b020-21af1ffa29de None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:27.512456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a210-4fe0-445d-b020-21af1ffa29de None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:27.512568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d5a210-4fe0-445d-b020-21af1ffa29de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:27.532101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c2d5a210-4fe0-445d-b020-21af1ffa29de None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:27.533358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c2d5a210-4fe0-445d-b020-21af1ffa29de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:27.541888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 692/1378] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:27.590540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c118e3-4e0f-4be2-a504-0e11c7d22ce1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:27.606476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c118e3-4e0f-4be2-a504-0e11c7d22ce1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:27.613222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a00bf-cd09-4cde-8070-736cd75e3afc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:27.613981 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a00bf-cd09-4cde-8070-736cd75e3afc service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:27.614311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a00bf-cd09-4cde-8070-736cd75e3afc service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:27.614632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a00bf-cd09-4cde-8070-736cd75e3afc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:27.624251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a00bf-cd09-4cde-8070-736cd75e3afc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:27.626991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a00bf-cd09-4cde-8070-736cd75e3afc service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:27.637996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 687/1379] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:30.387167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe503d82-84c0-46e7-bbc2-7f88c2d1e14e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:30.387726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe503d82-84c0-46e7-bbc2-7f88c2d1e14e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:30.387726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe503d82-84c0-46e7-bbc2-7f88c2d1e14e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:30.389093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 693/1380] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:30.395557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926020a1-5cc7-4976-8c38-06a424ddcabf None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:30.396051 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926020a1-5cc7-4976-8c38-06a424ddcabf None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:30.396148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926020a1-5cc7-4976-8c38-06a424ddcabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:30.416377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-926020a1-5cc7-4976-8c38-06a424ddcabf None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:30.417596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-926020a1-5cc7-4976-8c38-06a424ddcabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:30.426802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 688/1381] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:30.476243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe503d82-84c0-46e7-bbc2-7f88c2d1e14e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:30.494424 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe503d82-84c0-46e7-bbc2-7f88c2d1e14e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:30.500486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09da90d-0d8d-4625-9c41-f788c9294748 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:30.501152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da90d-0d8d-4625-9c41-f788c9294748 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:30.501446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da90d-0d8d-4625-9c41-f788c9294748 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:30.501753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09da90d-0d8d-4625-9c41-f788c9294748 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:30.511540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da90d-0d8d-4625-9c41-f788c9294748 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:30.514125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09da90d-0d8d-4625-9c41-f788c9294748 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:30.522299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:30.534626 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 694/1382] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:37:33.194177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7e40-f9af-475c-8888-441217461ec9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:33.195063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7e40-f9af-475c-8888-441217461ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:33.195345 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d7e40-f9af-475c-8888-441217461ec9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:33.196915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 689/1383] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:33.204917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf6ae2-9b1c-4a63-84d4-ed667644e271 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:33.204917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf6ae2-9b1c-4a63-84d4-ed667644e271 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:33.204917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf6ae2-9b1c-4a63-84d4-ed667644e271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:33.222202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8caf6ae2-9b1c-4a63-84d4-ed667644e271 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:33.223545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8caf6ae2-9b1c-4a63-84d4-ed667644e271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:33.238342 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 695/1384] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:33.274992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7e40-f9af-475c-8888-441217461ec9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:33.293812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d7e40-f9af-475c-8888-441217461ec9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:33.300426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a31a2c-367e-4c99-b408-4c11f3319771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:33.301352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31a2c-367e-4c99-b408-4c11f3319771 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:33.301881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31a2c-367e-4c99-b408-4c11f3319771 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:33.302370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a31a2c-367e-4c99-b408-4c11f3319771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:33.313055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a31a2c-367e-4c99-b408-4c11f3319771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:33.315114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a31a2c-367e-4c99-b408-4c11f3319771 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:33.327305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 690/1385] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:35.762999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0ba5-72f2-4956-8a7f-4c106c3b5449 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:35.763646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0ba5-72f2-4956-8a7f-4c106c3b5449 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:35.763646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a0ba5-72f2-4956-8a7f-4c106c3b5449 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:35.765181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 696/1386] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:35.773297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db35922-7e54-4dbd-b075-3507b08faf3a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:35.774150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db35922-7e54-4dbd-b075-3507b08faf3a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:35.775006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db35922-7e54-4dbd-b075-3507b08faf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:35.812433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4db35922-7e54-4dbd-b075-3507b08faf3a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:35.814025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4db35922-7e54-4dbd-b075-3507b08faf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:35.823684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 691/1387] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:35.878613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a0ba5-72f2-4956-8a7f-4c106c3b5449 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:35.895069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a0ba5-72f2-4956-8a7f-4c106c3b5449 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:35.900927 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e9fe1-18df-46b5-b0d8-25b318a9296f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:35.901536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9fe1-18df-46b5-b0d8-25b318a9296f service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:35.901862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9fe1-18df-46b5-b0d8-25b318a9296f service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:35.902197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9fe1-18df-46b5-b0d8-25b318a9296f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:35.912159 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e9fe1-18df-46b5-b0d8-25b318a9296f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:35.913769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e9fe1-18df-46b5-b0d8-25b318a9296f service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:35.931330 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 697/1388] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:37:38.778651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac60198-a600-456e-a682-f5b0b888c2c8 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:38.779565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac60198-a600-456e-a682-f5b0b888c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:38.779565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac60198-a600-456e-a682-f5b0b888c2c8 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:38.780673 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 692/1389] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:37:38.789862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302abaa6-0b2b-4b1d-8229-6afb4ac656b3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:38.790451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302abaa6-0b2b-4b1d-8229-6afb4ac656b3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:38.790597 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302abaa6-0b2b-4b1d-8229-6afb4ac656b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:38.816048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-302abaa6-0b2b-4b1d-8229-6afb4ac656b3 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:38.817622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-302abaa6-0b2b-4b1d-8229-6afb4ac656b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:38.828959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 698/1390] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:37:38.888636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac60198-a600-456e-a682-f5b0b888c2c8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:38.918595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac60198-a600-456e-a682-f5b0b888c2c8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:38.929012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c687aab-ca11-4382-99cb-2dd0171b87cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:38.930048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c687aab-ca11-4382-99cb-2dd0171b87cc service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:38.932006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c687aab-ca11-4382-99cb-2dd0171b87cc service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:38.932006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c687aab-ca11-4382-99cb-2dd0171b87cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:38.944867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c687aab-ca11-4382-99cb-2dd0171b87cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:38.947790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c687aab-ca11-4382-99cb-2dd0171b87cc service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:38.962105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 693/1391] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:41.982632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06793b8-b4d0-4e20-af38-9f705392a3cf None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:41.983577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06793b8-b4d0-4e20-af38-9f705392a3cf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:41.984015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06793b8-b4d0-4e20-af38-9f705392a3cf None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:41.986033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 699/1392] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:41.992535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d24e61-b8c9-4ca9-bc3f-0356789c23fe None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:41.993139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d24e61-b8c9-4ca9-bc3f-0356789c23fe None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:41.993274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d24e61-b8c9-4ca9-bc3f-0356789c23fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:42.000057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:42.014392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-95d24e61-b8c9-4ca9-bc3f-0356789c23fe None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:42.019400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-95d24e61-b8c9-4ca9-bc3f-0356789c23fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:42.024170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 694/1393] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:42.074982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06793b8-b4d0-4e20-af38-9f705392a3cf None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:42.097827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06793b8-b4d0-4e20-af38-9f705392a3cf None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:42.103345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa921c3-4010-4f18-8c30-f3f56975b99b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:42.104066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa921c3-4010-4f18-8c30-f3f56975b99b service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:42.104387 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa921c3-4010-4f18-8c30-f3f56975b99b service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:42.104838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa921c3-4010-4f18-8c30-f3f56975b99b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:42.115788 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa921c3-4010-4f18-8c30-f3f56975b99b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:42.118427 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa921c3-4010-4f18-8c30-f3f56975b99b service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:42.137259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 700/1394] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:42.734610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5faab-fa52-4e93-9833-0b27e0cdf61f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:42.735041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5faab-fa52-4e93-9833-0b27e0cdf61f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:42.735464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5faab-fa52-4e93-9833-0b27e0cdf61f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:42.737169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 695/1395] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:42.743903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73902eb-4e27-46b0-b313-e3467c6f8603 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:42.744303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73902eb-4e27-46b0-b313-e3467c6f8603 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:42.744672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73902eb-4e27-46b0-b313-e3467c6f8603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:42.764731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d73902eb-4e27-46b0-b313-e3467c6f8603 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:42.765989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d73902eb-4e27-46b0-b313-e3467c6f8603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:42.775391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 701/1396] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:37:42.833505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d1ca8-41af-4f6b-bf85-8a41a4f1a1ff None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:42.833838 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d1ca8-41af-4f6b-bf85-8a41a4f1a1ff None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:42.834107 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d1ca8-41af-4f6b-bf85-8a41a4f1a1ff None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:42.835742 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 696/1397] 10.222.0.41 () {54 vars in 962 bytes} [Thu May 26 12:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:42.841018 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2634dd-a9c5-4dbe-b386-046d61f8ef47 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:42.841309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2634dd-a9c5-4dbe-b386-046d61f8ef47 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:42.841591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2634dd-a9c5-4dbe-b386-046d61f8ef47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:42.915521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6c2634dd-a9c5-4dbe-b386-046d61f8ef47 None None] MFA Rules not processed for user `079eeefcd0654dfe9cd4a9c51d239298`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:42.917271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6c2634dd-a9c5-4dbe-b386-046d61f8ef47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:42.995073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 702/1398] 10.222.0.41 () {58 vars in 1059 bytes} [Thu May 26 12:37:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:43.006456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d1ca8-41af-4f6b-bf85-8a41a4f1a1ff None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:43.028556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d1ca8-41af-4f6b-bf85-8a41a4f1a1ff None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:43.034357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b55fce-4e41-4487-92fb-749cc7f6cada service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079eeefcd0654dfe9cd4a9c51d239298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:43.035458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b55fce-4e41-4487-92fb-749cc7f6cada service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:43.036031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b55fce-4e41-4487-92fb-749cc7f6cada service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:43.036394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b55fce-4e41-4487-92fb-749cc7f6cada service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:43.047810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b55fce-4e41-4487-92fb-749cc7f6cada service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:43.049323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b55fce-4e41-4487-92fb-749cc7f6cada service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:43.061442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 697/1399] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:43.950451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abae18-4d08-4cab-8373-981727e7283e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:43.950746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abae18-4d08-4cab-8373-981727e7283e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:43.951005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83abae18-4d08-4cab-8373-981727e7283e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:44.015398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-83abae18-4d08-4cab-8373-981727e7283e None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:44.016510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-83abae18-4d08-4cab-8373-981727e7283e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:44.098432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 703/1400] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:37:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:44.155669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117415d-747d-42be-ae20-6f33f848dcf6 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:44.156527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117415d-747d-42be-ae20-6f33f848dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:44.156842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117415d-747d-42be-ae20-6f33f848dcf6 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:44.159635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 698/1401] 10.222.0.41 () {54 vars in 942 bytes} [Thu May 26 12:37:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:44.169286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b32b-0859-4be5-af73-be49a9ef4e6f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:44.169975 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b32b-0859-4be5-af73-be49a9ef4e6f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:44.170492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86b32b-0859-4be5-af73-be49a9ef4e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:44.180285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:44.240437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-dd86b32b-0859-4be5-af73-be49a9ef4e6f None None] MFA Rules not processed for user `af5ebb39734144418fe35f9f0a679145`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:44.241746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dd86b32b-0859-4be5-af73-be49a9ef4e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:44.361441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 704/1402] 10.222.0.41 () {58 vars in 1039 bytes} [Thu May 26 12:37:44 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:44.375318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117415d-747d-42be-ae20-6f33f848dcf6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:44.390065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117415d-747d-42be-ae20-6f33f848dcf6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:44.396158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea7cb5-b19f-42d0-97bf-3b50b380866f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:44.396933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea7cb5-b19f-42d0-97bf-3b50b380866f service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:44.397296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea7cb5-b19f-42d0-97bf-3b50b380866f service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:44.397641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea7cb5-b19f-42d0-97bf-3b50b380866f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:44.407212 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea7cb5-b19f-42d0-97bf-3b50b380866f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:44.409539 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea7cb5-b19f-42d0-97bf-3b50b380866f service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:44.419983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 699/1403] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:37:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:37:44.737515 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f679820-9026-4f83-bd14-b1493246eefe None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:44.737855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f679820-9026-4f83-bd14-b1493246eefe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:44.738134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f679820-9026-4f83-bd14-b1493246eefe None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:44.739970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 705/1404] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:37:44.746440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b508b2-a878-4731-b10d-213074701b52 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:44.746440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b508b2-a878-4731-b10d-213074701b52 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:44.747292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b508b2-a878-4731-b10d-213074701b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:44.768396 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a6b508b2-a878-4731-b10d-213074701b52 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:44.769782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a6b508b2-a878-4731-b10d-213074701b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:44.778017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 700/1405] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:37:44.828156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f679820-9026-4f83-bd14-b1493246eefe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:44.845347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f679820-9026-4f83-bd14-b1493246eefe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:44.852613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cda5b-5b7f-447b-8641-a75861457a6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:44.853368 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cda5b-5b7f-447b-8641-a75861457a6c service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:44.853729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cda5b-5b7f-447b-8641-a75861457a6c service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:44.854070 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cda5b-5b7f-447b-8641-a75861457a6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:44.864105 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cda5b-5b7f-447b-8641-a75861457a6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:44.865914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cda5b-5b7f-447b-8641-a75861457a6c service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:44.876436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 706/1406] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:47.878615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0badd9a-42b5-4aee-baa2-3a4b1d8fe1f5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:47.879528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0badd9a-42b5-4aee-baa2-3a4b1d8fe1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:47.879528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0badd9a-42b5-4aee-baa2-3a4b1d8fe1f5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:47.884961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 701/1407] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:37:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:37:47.889246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9580e4-8ca0-40ae-9e67-ff094b2aac61 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:47.890029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9580e4-8ca0-40ae-9e67-ff094b2aac61 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:47.890204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9580e4-8ca0-40ae-9e67-ff094b2aac61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:47.924343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3b9580e4-8ca0-40ae-9e67-ff094b2aac61 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:37:47.925705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3b9580e4-8ca0-40ae-9e67-ff094b2aac61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:37:47.940078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 707/1408] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:37:47.993129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0badd9a-42b5-4aee-baa2-3a4b1d8fe1f5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:37:48.020571 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0badd9a-42b5-4aee-baa2-3a4b1d8fe1f5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:37:48.029338 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e967c9-2a72-49e5-a357-f67d155f1450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:37:48.033929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e967c9-2a72-49e5-a357-f67d155f1450 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:37:48.033929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e967c9-2a72-49e5-a357-f67d155f1450 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:37:48.033929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e967c9-2a72-49e5-a357-f67d155f1450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:37:48.042841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e967c9-2a72-49e5-a357-f67d155f1450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:37:48.045486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e967c9-2a72-49e5-a357-f67d155f1450 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:37:48.063436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 702/1409] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:37:57.912696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=52 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:37:58.057509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=23 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:10.577386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493c7f-67e6-42ef-84d2-49f7dc10c21f None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.578313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493c7f-67e6-42ef-84d2-49f7dc10c21f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.578477 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493c7f-67e6-42ef-84d2-49f7dc10c21f None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.580253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 708/1410] 10.222.0.41 () {54 vars in 918 bytes} [Thu May 26 12:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:10.586348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e530b4-eaa0-40b2-8ff2-8eea70abc00d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.586945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e530b4-eaa0-40b2-8ff2-8eea70abc00d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.586945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e530b4-eaa0-40b2-8ff2-8eea70abc00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.605621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-85e530b4-eaa0-40b2-8ff2-8eea70abc00d None None] MFA Rules not processed for user `0412209ee10a46558a8baf10b59f89a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:10.606870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-85e530b4-eaa0-40b2-8ff2-8eea70abc00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:10.618353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 703/1411] 10.222.0.41 () {58 vars in 1015 bytes} [Thu May 26 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:10.634261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e258ed-7ed5-408c-ba35-71431cf10a60 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.634555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e258ed-7ed5-408c-ba35-71431cf10a60 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.634841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e258ed-7ed5-408c-ba35-71431cf10a60 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.636196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 709/1412] 10.222.0.41 () {54 vars in 918 bytes} [Thu May 26 12:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:10.642435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e02f1-a82e-4c29-a56e-a5d7b8354849 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:10.642739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e02f1-a82e-4c29-a56e-a5d7b8354849 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:10.643028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e02f1-a82e-4c29-a56e-a5d7b8354849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:10.663455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a77e02f1-a82e-4c29-a56e-a5d7b8354849 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:10.664874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a77e02f1-a82e-4c29-a56e-a5d7b8354849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:10.675238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 704/1413] 10.222.0.41 () {58 vars in 1015 bytes} [Thu May 26 12:38:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:13.477692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329deb37-717a-4004-878e-09e1aab89d0e None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.478267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329deb37-717a-4004-878e-09e1aab89d0e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.478378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329deb37-717a-4004-878e-09e1aab89d0e None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.479868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:13.491115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bd4cf-4ef8-4e01-92e5-fbfa2da77478 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.491636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bd4cf-4ef8-4e01-92e5-fbfa2da77478 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.491758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bd4cf-4ef8-4e01-92e5-fbfa2da77478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.510685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c90bd4cf-4ef8-4e01-92e5-fbfa2da77478 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:13.511917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c90bd4cf-4ef8-4e01-92e5-fbfa2da77478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:13.520811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:13.572273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329deb37-717a-4004-878e-09e1aab89d0e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:13.590968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329deb37-717a-4004-878e-09e1aab89d0e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:13.597322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a5fe3-08e1-4e27-b3fc-1d7cfce0738f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:13.598005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a5fe3-08e1-4e27-b3fc-1d7cfce0738f service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:13.598283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a5fe3-08e1-4e27-b3fc-1d7cfce0738f service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:13.598562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a5fe3-08e1-4e27-b3fc-1d7cfce0738f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:13.607756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a5fe3-08e1-4e27-b3fc-1d7cfce0738f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:13.609672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a5fe3-08e1-4e27-b3fc-1d7cfce0738f service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:13.619776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 711/1416] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:14.624355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c678a3a-e2a9-4a56-95f5-41da9bd86fb7 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:14.625300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c678a3a-e2a9-4a56-95f5-41da9bd86fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:14.625300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c678a3a-e2a9-4a56-95f5-41da9bd86fb7 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:14.626364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:14.632612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69183-6cc5-4d95-9d72-d8cef8340db7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:14.633528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69183-6cc5-4d95-9d72-d8cef8340db7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:14.633528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69183-6cc5-4d95-9d72-d8cef8340db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:14.654177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cfe69183-6cc5-4d95-9d72-d8cef8340db7 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:14.655456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cfe69183-6cc5-4d95-9d72-d8cef8340db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:14.664134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:14.854677 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c678a3a-e2a9-4a56-95f5-41da9bd86fb7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:14.871105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c678a3a-e2a9-4a56-95f5-41da9bd86fb7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:14.876934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17145e0-a895-4384-b91e-26145ffb50d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:14.877549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17145e0-a895-4384-b91e-26145ffb50d2 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:14.877858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17145e0-a895-4384-b91e-26145ffb50d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:14.878159 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17145e0-a895-4384-b91e-26145ffb50d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:14.887206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17145e0-a895-4384-b91e-26145ffb50d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:14.888879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17145e0-a895-4384-b91e-26145ffb50d2 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:14.900156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 707/1419] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:15.879961 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155ea7f-d250-406e-aaea-fcaae2510cab None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:15.880502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155ea7f-d250-406e-aaea-fcaae2510cab None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:15.880502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155ea7f-d250-406e-aaea-fcaae2510cab None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:15.882053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:15.887533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd952c-9b8b-423b-b1bf-70f8ed267975 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:15.888746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd952c-9b8b-423b-b1bf-70f8ed267975 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:15.888746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd952c-9b8b-423b-b1bf-70f8ed267975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:15.909726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0dbd952c-9b8b-423b-b1bf-70f8ed267975 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:15.910952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0dbd952c-9b8b-423b-b1bf-70f8ed267975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:15.919165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:16.072715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155ea7f-d250-406e-aaea-fcaae2510cab None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:16.088385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155ea7f-d250-406e-aaea-fcaae2510cab None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:16.094209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fb75f-f09d-40e1-a45e-fc2d1f7dfdbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:16.094891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fb75f-f09d-40e1-a45e-fc2d1f7dfdbd service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.095728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fb75f-f09d-40e1-a45e-fc2d1f7dfdbd service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.096009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fb75f-f09d-40e1-a45e-fc2d1f7dfdbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.104800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fb75f-f09d-40e1-a45e-fc2d1f7dfdbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:16.106551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fb75f-f09d-40e1-a45e-fc2d1f7dfdbd service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:16.117358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 714/1422] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:17.066482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426384d-9477-4f4b-9b0a-7a799d794cba None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:17.066482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426384d-9477-4f4b-9b0a-7a799d794cba None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:17.066482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9426384d-9477-4f4b-9b0a-7a799d794cba None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:17.066482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:17.071055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24107734-8f6a-4544-8016-0e7d4c7a44af None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:17.071508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24107734-8f6a-4544-8016-0e7d4c7a44af None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:17.071644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24107734-8f6a-4544-8016-0e7d4c7a44af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:17.090217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-24107734-8f6a-4544-8016-0e7d4c7a44af None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:17.091430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-24107734-8f6a-4544-8016-0e7d4c7a44af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:17.099532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:17.251675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426384d-9477-4f4b-9b0a-7a799d794cba None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:17.266345 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9426384d-9477-4f4b-9b0a-7a799d794cba None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:17.272516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a29de-a452-4da0-9c0e-0862e1b05b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:17.273209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a29de-a452-4da0-9c0e-0862e1b05b26 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:17.273492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a29de-a452-4da0-9c0e-0862e1b05b26 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:17.273815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a29de-a452-4da0-9c0e-0862e1b05b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:17.283485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a29de-a452-4da0-9c0e-0862e1b05b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:17.285073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04a29de-a452-4da0-9c0e-0862e1b05b26 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:17.294809 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 710/1425] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:18.223814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ee29-69d8-40d3-a5f1-bf1ffdd57e90 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.224379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ee29-69d8-40d3-a5f1-bf1ffdd57e90 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.224379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373ee29-69d8-40d3-a5f1-bf1ffdd57e90 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.225945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:18.231063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d62fc6-4744-4eae-9ce3-c48067f60344 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.231654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d62fc6-4744-4eae-9ce3-c48067f60344 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.231654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d62fc6-4744-4eae-9ce3-c48067f60344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.259839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b5d62fc6-4744-4eae-9ce3-c48067f60344 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:18.267239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b5d62fc6-4744-4eae-9ce3-c48067f60344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:18.275790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:18.429178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373ee29-69d8-40d3-a5f1-bf1ffdd57e90 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:18.443676 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373ee29-69d8-40d3-a5f1-bf1ffdd57e90 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:18.449235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92e1ba-524c-4a68-8450-711103960c5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:18.449915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92e1ba-524c-4a68-8450-711103960c5f service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:18.450197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92e1ba-524c-4a68-8450-711103960c5f service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:18.450475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92e1ba-524c-4a68-8450-711103960c5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:18.460005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92e1ba-524c-4a68-8450-711103960c5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:18.461817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92e1ba-524c-4a68-8450-711103960c5f service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:18.471925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 717/1428] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:19.438910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b6329-76f7-4c31-ab57-83b5d73c89bb None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.439496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b6329-76f7-4c31-ab57-83b5d73c89bb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.439496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b6329-76f7-4c31-ab57-83b5d73c89bb None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.440845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:19.445966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dc7ab-a700-4ff3-a3ad-b9b99c73f689 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.446388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dc7ab-a700-4ff3-a3ad-b9b99c73f689 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.446534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286dc7ab-a700-4ff3-a3ad-b9b99c73f689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.464790 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-286dc7ab-a700-4ff3-a3ad-b9b99c73f689 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:19.467963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-286dc7ab-a700-4ff3-a3ad-b9b99c73f689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:19.474709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:19.634269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b6329-76f7-4c31-ab57-83b5d73c89bb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.649366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b6329-76f7-4c31-ab57-83b5d73c89bb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:19.655637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b281e4-8295-4e9b-a9af-2e5c27acb174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:19.656343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b281e4-8295-4e9b-a9af-2e5c27acb174 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.656675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b281e4-8295-4e9b-a9af-2e5c27acb174 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.656993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b281e4-8295-4e9b-a9af-2e5c27acb174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.666593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b281e4-8295-4e9b-a9af-2e5c27acb174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:19.668196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b281e4-8295-4e9b-a9af-2e5c27acb174 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:19.679234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 713/1431] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:20.671152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44cf09-cad4-4d00-afe6-2b0a2f30912c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.671728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44cf09-cad4-4d00-afe6-2b0a2f30912c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.671728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44cf09-cad4-4d00-afe6-2b0a2f30912c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.673550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:20.678906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec21f-e571-4f03-a253-bf6245235527 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.679318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec21f-e571-4f03-a253-bf6245235527 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.679469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ec21f-e571-4f03-a253-bf6245235527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.697871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-691ec21f-e571-4f03-a253-bf6245235527 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:20.699083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-691ec21f-e571-4f03-a253-bf6245235527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:20.707029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:20.856891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44cf09-cad4-4d00-afe6-2b0a2f30912c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:20.872674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44cf09-cad4-4d00-afe6-2b0a2f30912c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:20.878756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c2336-4e8e-4abc-b5d5-cdb56c56ad61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:20.879400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2336-4e8e-4abc-b5d5-cdb56c56ad61 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.879688 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2336-4e8e-4abc-b5d5-cdb56c56ad61 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.879992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c2336-4e8e-4abc-b5d5-cdb56c56ad61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.888599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2336-4e8e-4abc-b5d5-cdb56c56ad61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:20.890215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c2336-4e8e-4abc-b5d5-cdb56c56ad61 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:20.899668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 720/1434] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:21.928271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d7ff-9f5a-4680-b34e-8c92728ee700 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:21.928849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d7ff-9f5a-4680-b34e-8c92728ee700 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:21.928849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3d7ff-9f5a-4680-b34e-8c92728ee700 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:21.930255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:21.935675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb18d21-5394-4bd5-8fa0-029d692bc5a1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:21.936183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb18d21-5394-4bd5-8fa0-029d692bc5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:21.936280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb18d21-5394-4bd5-8fa0-029d692bc5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:21.957069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7eb18d21-5394-4bd5-8fa0-029d692bc5a1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:21.958329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7eb18d21-5394-4bd5-8fa0-029d692bc5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:21.966774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:22.118933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d7ff-9f5a-4680-b34e-8c92728ee700 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:22.134083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3d7ff-9f5a-4680-b34e-8c92728ee700 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:22.139779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4217d-48b4-48f0-ad45-d10b44e15d95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:22.140435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4217d-48b4-48f0-ad45-d10b44e15d95 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:22.140720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4217d-48b4-48f0-ad45-d10b44e15d95 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:22.141009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4217d-48b4-48f0-ad45-d10b44e15d95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:22.150728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4217d-48b4-48f0-ad45-d10b44e15d95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:22.152309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4217d-48b4-48f0-ad45-d10b44e15d95 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:22.163269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 716/1437] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:23.203258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587bb9d-72e3-47f8-b10a-bb4ceeb724ae None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.204026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587bb9d-72e3-47f8-b10a-bb4ceeb724ae None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.204026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0587bb9d-72e3-47f8-b10a-bb4ceeb724ae None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.205258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:23.212052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41753-8d73-48a3-a8ef-2b3633487387 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.212657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41753-8d73-48a3-a8ef-2b3633487387 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.213071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d41753-8d73-48a3-a8ef-2b3633487387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.237981 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-92d41753-8d73-48a3-a8ef-2b3633487387 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:23.239236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-92d41753-8d73-48a3-a8ef-2b3633487387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.247552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:23.400437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587bb9d-72e3-47f8-b10a-bb4ceeb724ae None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:23.416308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0587bb9d-72e3-47f8-b10a-bb4ceeb724ae None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:23.421817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa90ab1-ebd2-4695-816b-03e699036806 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:23.422476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa90ab1-ebd2-4695-816b-03e699036806 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.422811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa90ab1-ebd2-4695-816b-03e699036806 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.423600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa90ab1-ebd2-4695-816b-03e699036806 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.433201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa90ab1-ebd2-4695-816b-03e699036806 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:23.434838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa90ab1-ebd2-4695-816b-03e699036806 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:23.445258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 723/1440] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:25.559889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef7db7-5192-4281-8fe8-b17958ae368d None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.560455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef7db7-5192-4281-8fe8-b17958ae368d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.560455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef7db7-5192-4281-8fe8-b17958ae368d None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.561979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:25.568390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62422ee0-0597-4a13-94dc-44d213c90845 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.568926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62422ee0-0597-4a13-94dc-44d213c90845 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.569022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62422ee0-0597-4a13-94dc-44d213c90845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.587539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-62422ee0-0597-4a13-94dc-44d213c90845 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:25.589221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-62422ee0-0597-4a13-94dc-44d213c90845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:25.597617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:25.637282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef7db7-5192-4281-8fe8-b17958ae368d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:25.648443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef7db7-5192-4281-8fe8-b17958ae368d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:25.652545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6333d-dca9-4cda-bcdd-16804dd15602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:25.653205 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6333d-dca9-4cda-bcdd-16804dd15602 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:25.653494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6333d-dca9-4cda-bcdd-16804dd15602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:25.653812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6333d-dca9-4cda-bcdd-16804dd15602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:25.665358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6333d-dca9-4cda-bcdd-16804dd15602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:25.666837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f6333d-dca9-4cda-bcdd-16804dd15602 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:25.677626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 719/1443] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:28.171348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fef077-7af9-4aa6-9455-84ffe047b26c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:28.171924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fef077-7af9-4aa6-9455-84ffe047b26c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:28.172033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fef077-7af9-4aa6-9455-84ffe047b26c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:28.173652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:38:28.180266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fea128-c2e1-409f-acd0-37a3dcf5919d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:28.180795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fea128-c2e1-409f-acd0-37a3dcf5919d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:28.181195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fea128-c2e1-409f-acd0-37a3dcf5919d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:28.210761 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f4fea128-c2e1-409f-acd0-37a3dcf5919d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:28.212849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f4fea128-c2e1-409f-acd0-37a3dcf5919d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:28.227214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:28.288350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fef077-7af9-4aa6-9455-84ffe047b26c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:28.299747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fef077-7af9-4aa6-9455-84ffe047b26c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:28.303442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ecc7a-bd3c-4194-8b99-8483d4973e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:28.304089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ecc7a-bd3c-4194-8b99-8483d4973e45 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:28.304379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ecc7a-bd3c-4194-8b99-8483d4973e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:28.304778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ecc7a-bd3c-4194-8b99-8483d4973e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:28.314550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ecc7a-bd3c-4194-8b99-8483d4973e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:28.316047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ecc7a-bd3c-4194-8b99-8483d4973e45 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:28.327805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 726/1446] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:31.073898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cab1a7-516b-428c-82a1-ea47a7a10fe3 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:31.074503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cab1a7-516b-428c-82a1-ea47a7a10fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:31.074503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cab1a7-516b-428c-82a1-ea47a7a10fe3 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:31.075896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:31.082300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6cd2d-2288-4e4b-bf61-6e999e809e45 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:31.082924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6cd2d-2288-4e4b-bf61-6e999e809e45 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:31.082924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6cd2d-2288-4e4b-bf61-6e999e809e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:31.100876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-19e6cd2d-2288-4e4b-bf61-6e999e809e45 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:31.102137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-19e6cd2d-2288-4e4b-bf61-6e999e809e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:31.110940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:31.149485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cab1a7-516b-428c-82a1-ea47a7a10fe3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:31.160796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cab1a7-516b-428c-82a1-ea47a7a10fe3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:31.165002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae61fa-8d7a-4e24-89f8-c2147684fbef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:31.165648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae61fa-8d7a-4e24-89f8-c2147684fbef service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:31.165968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae61fa-8d7a-4e24-89f8-c2147684fbef service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:31.166246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae61fa-8d7a-4e24-89f8-c2147684fbef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:31.176784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae61fa-8d7a-4e24-89f8-c2147684fbef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:31.178481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae61fa-8d7a-4e24-89f8-c2147684fbef service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:31.189710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 722/1449] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:33.594238 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982ddf7-97df-423f-b7e1-aec4e36d87c6 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:33.595106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982ddf7-97df-423f-b7e1-aec4e36d87c6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:33.595331 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982ddf7-97df-423f-b7e1-aec4e36d87c6 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:33.596795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:33.603560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0e231-843b-44b6-acc8-4436e1a63d5a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:33.604400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0e231-843b-44b6-acc8-4436e1a63d5a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:33.604400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a0e231-843b-44b6-acc8-4436e1a63d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:33.630945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-50a0e231-843b-44b6-acc8-4436e1a63d5a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:33.632699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-50a0e231-843b-44b6-acc8-4436e1a63d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:33.644747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:33.683738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982ddf7-97df-423f-b7e1-aec4e36d87c6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:33.701075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982ddf7-97df-423f-b7e1-aec4e36d87c6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:33.706753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05b1b9-a5ef-452a-b157-dbba2c154b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:33.707581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b1b9-a5ef-452a-b157-dbba2c154b95 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:33.707974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b1b9-a5ef-452a-b157-dbba2c154b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:33.708357 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05b1b9-a5ef-452a-b157-dbba2c154b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:33.720109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05b1b9-a5ef-452a-b157-dbba2c154b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:33.722242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05b1b9-a5ef-452a-b157-dbba2c154b95 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:33.734016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 729/1452] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:36.106528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098b79-dbd7-4dfa-9a0e-0b71ae8c44e9 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.107085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098b79-dbd7-4dfa-9a0e-0b71ae8c44e9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.107310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a098b79-dbd7-4dfa-9a0e-0b71ae8c44e9 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.109202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:36.115754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22def68a-7691-4898-a475-47ced271f504 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.116323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22def68a-7691-4898-a475-47ced271f504 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.116323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22def68a-7691-4898-a475-47ced271f504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.137853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-22def68a-7691-4898-a475-47ced271f504 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:36.139117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-22def68a-7691-4898-a475-47ced271f504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:36.147403 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:36.187296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a098b79-dbd7-4dfa-9a0e-0b71ae8c44e9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:36.198759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a098b79-dbd7-4dfa-9a0e-0b71ae8c44e9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:36.202467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02f69e-d9ac-4e6f-9800-afaf71916345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:36.203130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02f69e-d9ac-4e6f-9800-afaf71916345 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.203421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02f69e-d9ac-4e6f-9800-afaf71916345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.203708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02f69e-d9ac-4e6f-9800-afaf71916345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.214038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02f69e-d9ac-4e6f-9800-afaf71916345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:36.215507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02f69e-d9ac-4e6f-9800-afaf71916345 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:36.227017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 725/1455] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:38.565539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae768b-34f1-45b3-bc1e-78ea74ea62c7 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.566134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae768b-34f1-45b3-bc1e-78ea74ea62c7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.566134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae768b-34f1-45b3-bc1e-78ea74ea62c7 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.567569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:38:38.573727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4404721-1c9b-489b-88c6-bc9cc750d3a9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.574304 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4404721-1c9b-489b-88c6-bc9cc750d3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.574304 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4404721-1c9b-489b-88c6-bc9cc750d3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.580589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=70 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:38.593183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e4404721-1c9b-489b-88c6-bc9cc750d3a9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:38.597072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e4404721-1c9b-489b-88c6-bc9cc750d3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:38.602529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:38.642407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae768b-34f1-45b3-bc1e-78ea74ea62c7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:38.650267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=64 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:38.657479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae768b-34f1-45b3-bc1e-78ea74ea62c7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:38.661304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76b932-4957-4616-9eb2-72b4db455d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:38.668240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76b932-4957-4616-9eb2-72b4db455d7c service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:38.668240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76b932-4957-4616-9eb2-72b4db455d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:38.668240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76b932-4957-4616-9eb2-72b4db455d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:38.676205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76b932-4957-4616-9eb2-72b4db455d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:38.676205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76b932-4957-4616-9eb2-72b4db455d7c service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:38.685344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 732/1458] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:41.035524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b41762-2b0b-47ab-a157-20fb6fa5494f None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.036336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b41762-2b0b-47ab-a157-20fb6fa5494f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.036336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b41762-2b0b-47ab-a157-20fb6fa5494f None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.037483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:41.045305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6ef3-a990-4e86-82b6-45eb483b53de None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.045870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6ef3-a990-4e86-82b6-45eb483b53de None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.046109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e6ef3-a990-4e86-82b6-45eb483b53de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.070591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7d6e6ef3-a990-4e86-82b6-45eb483b53de None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:41.077649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7d6e6ef3-a990-4e86-82b6-45eb483b53de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:41.082797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:41.121133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b41762-2b0b-47ab-a157-20fb6fa5494f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:41.134354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b41762-2b0b-47ab-a157-20fb6fa5494f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:41.138695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9f2c7-4fed-4642-94df-ab444d6257ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:41.139469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9f2c7-4fed-4642-94df-ab444d6257ba service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:41.139859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9f2c7-4fed-4642-94df-ab444d6257ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:41.140236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9f2c7-4fed-4642-94df-ab444d6257ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:41.151148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9f2c7-4fed-4642-94df-ab444d6257ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:41.152810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9f2c7-4fed-4642-94df-ab444d6257ba service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:41.166543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 728/1461] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:43.591185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa83d2a-a830-428b-9ca5-920e147f3ee5 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.592064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa83d2a-a830-428b-9ca5-920e147f3ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.592064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa83d2a-a830-428b-9ca5-920e147f3ee5 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.593309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:43.599832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5ad18-621a-49e1-a4e5-1b91e108d9b2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.600459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5ad18-621a-49e1-a4e5-1b91e108d9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.600459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5ad18-621a-49e1-a4e5-1b91e108d9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.620670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-22e5ad18-621a-49e1-a4e5-1b91e108d9b2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:43.621963 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-22e5ad18-621a-49e1-a4e5-1b91e108d9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:43.632049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:43.671800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa83d2a-a830-428b-9ca5-920e147f3ee5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:43.683818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa83d2a-a830-428b-9ca5-920e147f3ee5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:43.687500 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f6521-85d0-4f1c-8453-15fc5038cbbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:43.688733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f6521-85d0-4f1c-8453-15fc5038cbbd service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.689405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f6521-85d0-4f1c-8453-15fc5038cbbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.689709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f6521-85d0-4f1c-8453-15fc5038cbbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.705994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f6521-85d0-4f1c-8453-15fc5038cbbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:43.708691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f6521-85d0-4f1c-8453-15fc5038cbbd service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:43.722278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 735/1464] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:46.043716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8fee-354e-4ce2-890a-1a5348954998 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.044261 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8fee-354e-4ce2-890a-1a5348954998 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.044261 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a8fee-354e-4ce2-890a-1a5348954998 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.045695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:46.052048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485c51-75b2-4d37-bea8-785f18573f48 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.052585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485c51-75b2-4d37-bea8-785f18573f48 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.052754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90485c51-75b2-4d37-bea8-785f18573f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.079219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-90485c51-75b2-4d37-bea8-785f18573f48 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:46.079219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-90485c51-75b2-4d37-bea8-785f18573f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:46.084844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:46.123353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a8fee-354e-4ce2-890a-1a5348954998 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:46.138596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a8fee-354e-4ce2-890a-1a5348954998 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:46.142366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bd71f-6d22-4a76-ae51-0231e98d1d2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:46.143014 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bd71f-6d22-4a76-ae51-0231e98d1d2e service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:46.143297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bd71f-6d22-4a76-ae51-0231e98d1d2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:46.143574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bd71f-6d22-4a76-ae51-0231e98d1d2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:46.159073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bd71f-6d22-4a76-ae51-0231e98d1d2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:46.161552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bd71f-6d22-4a76-ae51-0231e98d1d2e service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:46.177749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 731/1467] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:38:48.468643 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa32210-be1a-4f71-b1ce-0397c09285ad None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:48.469287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa32210-be1a-4f71-b1ce-0397c09285ad None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:48.469287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa32210-be1a-4f71-b1ce-0397c09285ad None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:48.470770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:48.478675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a816-d7da-4123-a988-1b06e873dd5b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:48.479189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a816-d7da-4123-a988-1b06e873dd5b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:48.479323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814a816-d7da-4123-a988-1b06e873dd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:48.497917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d814a816-d7da-4123-a988-1b06e873dd5b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:48.499131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d814a816-d7da-4123-a988-1b06e873dd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:48.507962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:48.543698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa32210-be1a-4f71-b1ce-0397c09285ad None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:48.555449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa32210-be1a-4f71-b1ce-0397c09285ad None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:48.559386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316b1cb-df7e-4389-8ef7-be9f7f464d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:48.560057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316b1cb-df7e-4389-8ef7-be9f7f464d70 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:48.560411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316b1cb-df7e-4389-8ef7-be9f7f464d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:48.560727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316b1cb-df7e-4389-8ef7-be9f7f464d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:48.571357 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316b1cb-df7e-4389-8ef7-be9f7f464d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:48.572860 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316b1cb-df7e-4389-8ef7-be9f7f464d70 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:48.583267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 738/1470] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:58.492486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=20 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:58.579007 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=23 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:22.703143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95cf3-0e91-485e-b448-465301981bf6 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.703742 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95cf3-0e91-485e-b448-465301981bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.703742 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95cf3-0e91-485e-b448-465301981bf6 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.705007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 733/1471] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:22.710793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275a04-c14d-409d-9e99-8a5accbf8242 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.711259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275a04-c14d-409d-9e99-8a5accbf8242 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.711360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c275a04-c14d-409d-9e99-8a5accbf8242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.730195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7c275a04-c14d-409d-9e99-8a5accbf8242 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:22.731434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7c275a04-c14d-409d-9e99-8a5accbf8242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:22.740730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 739/1472] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:22.788294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd298-7eb7-4a41-af07-194e151ea2a0 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.788593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd298-7eb7-4a41-af07-194e151ea2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.788880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecd298-7eb7-4a41-af07-194e151ea2a0 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.790353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 734/1473] 10.222.0.41 () {54 vars in 962 bytes} [Thu May 26 12:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:22.795224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3bb6-c606-45fc-9e43-68e0aaee5b78 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.795517 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3bb6-c606-45fc-9e43-68e0aaee5b78 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.795801 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb3bb6-c606-45fc-9e43-68e0aaee5b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.817154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-70eb3bb6-c606-45fc-9e43-68e0aaee5b78 None None] MFA Rules not processed for user `079eeefcd0654dfe9cd4a9c51d239298`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:22.818415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-70eb3bb6-c606-45fc-9e43-68e0aaee5b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:22.825300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 740/1474] 10.222.0.41 () {58 vars in 1059 bytes} [Thu May 26 12:39:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:22.833545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd298-7eb7-4a41-af07-194e151ea2a0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:22.844911 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecd298-7eb7-4a41-af07-194e151ea2a0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:22.848641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a71ecb-0eba-4cba-ad1f-e0cf606f1a74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079eeefcd0654dfe9cd4a9c51d239298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:22.849284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a71ecb-0eba-4cba-ad1f-e0cf606f1a74 service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:22.849573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a71ecb-0eba-4cba-ad1f-e0cf606f1a74 service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:22.849883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a71ecb-0eba-4cba-ad1f-e0cf606f1a74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:22.860701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a71ecb-0eba-4cba-ad1f-e0cf606f1a74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:22.862220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a71ecb-0eba-4cba-ad1f-e0cf606f1a74 service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:22.872157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 735/1475] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:25.211942 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683e901-b8de-46a5-969e-5a12f0d00bc0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.212513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683e901-b8de-46a5-969e-5a12f0d00bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.212828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7683e901-b8de-46a5-969e-5a12f0d00bc0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.214906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 741/1476] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:39:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:25.222767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e856c-39c6-413c-b65b-64001024f774 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.223226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e856c-39c6-413c-b65b-64001024f774 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.223328 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e856c-39c6-413c-b65b-64001024f774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.241954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e10e856c-39c6-413c-b65b-64001024f774 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:25.243184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e10e856c-39c6-413c-b65b-64001024f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:25.251812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 736/1477] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:25.276347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683e901-b8de-46a5-969e-5a12f0d00bc0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:25.290859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7683e901-b8de-46a5-969e-5a12f0d00bc0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:25.295452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd1399-e570-436b-919e-c83fb8d4df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:25.296103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1399-e570-436b-919e-c83fb8d4df7a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:25.296441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1399-e570-436b-919e-c83fb8d4df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:25.296751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd1399-e570-436b-919e-c83fb8d4df7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:25.297484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd1399-e570-436b-919e-c83fb8d4df7a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:25.299338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: WARNING py.warnings [None req-92fd1399-e570-436b-919e-c83fb8d4df7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:39:25.299338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: warnings.warn(msg) May 26 12:39:25.299338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: May 26 12:39:25.300504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fd1399-e570-436b-919e-c83fb8d4df7a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:25.322400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 742/1478] 10.222.0.41 () {56 vars in 1108 bytes} [Thu May 26 12:39:25 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:39:27.598193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5c285-31f6-4ea8-9209-f283d341a7d8 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.599031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5c285-31f6-4ea8-9209-f283d341a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.599031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5c285-31f6-4ea8-9209-f283d341a7d8 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.600279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 737/1479] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:27.606199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9955-5172-4bd7-bc20-9304f67994e9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.607188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9955-5172-4bd7-bc20-9304f67994e9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.607188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889f9955-5172-4bd7-bc20-9304f67994e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.626273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-889f9955-5172-4bd7-bc20-9304f67994e9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:27.627520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-889f9955-5172-4bd7-bc20-9304f67994e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.635838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 743/1480] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:39:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:27.680321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5c285-31f6-4ea8-9209-f283d341a7d8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.695551 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5c285-31f6-4ea8-9209-f283d341a7d8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.701454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a56ad-efdd-44eb-9112-8172d6f4de55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.702746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a56ad-efdd-44eb-9112-8172d6f4de55 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.702995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a56ad-efdd-44eb-9112-8172d6f4de55 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.703279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a56ad-efdd-44eb-9112-8172d6f4de55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.714735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a56ad-efdd-44eb-9112-8172d6f4de55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.716269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a56ad-efdd-44eb-9112-8172d6f4de55 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.731266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 738/1481] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:30.112506 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ba74-e3c0-491d-9e43-4c1313fc9171 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.113093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ba74-e3c0-491d-9e43-4c1313fc9171 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.113093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0ba74-e3c0-491d-9e43-4c1313fc9171 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.114473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 744/1482] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:30.120146 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67051a-2b7b-484a-9356-3c2c2230aeae None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.120786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67051a-2b7b-484a-9356-3c2c2230aeae None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.120786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67051a-2b7b-484a-9356-3c2c2230aeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.139751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4e67051a-2b7b-484a-9356-3c2c2230aeae None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:30.141498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4e67051a-2b7b-484a-9356-3c2c2230aeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:30.150088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 739/1483] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:30.185226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0ba74-e3c0-491d-9e43-4c1313fc9171 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:30.196733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0ba74-e3c0-491d-9e43-4c1313fc9171 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:30.200298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d087e35-d26a-4476-b493-29df86ffadde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:30.200943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d087e35-d26a-4476-b493-29df86ffadde service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:30.201231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d087e35-d26a-4476-b493-29df86ffadde service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:30.201510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d087e35-d26a-4476-b493-29df86ffadde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:30.211652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d087e35-d26a-4476-b493-29df86ffadde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:30.213094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d087e35-d26a-4476-b493-29df86ffadde service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:30.222666 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 745/1484] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:32.504881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561669f-1521-4e64-b75e-1c576a3c0a67 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:32.505471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561669f-1521-4e64-b75e-1c576a3c0a67 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:32.505471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7561669f-1521-4e64-b75e-1c576a3c0a67 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:32.506879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 740/1485] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:32.513153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beaff3-e85d-4243-9fe0-0de59a647d89 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:32.513704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beaff3-e85d-4243-9fe0-0de59a647d89 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:32.513809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2beaff3-e85d-4243-9fe0-0de59a647d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:32.538616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a2beaff3-e85d-4243-9fe0-0de59a647d89 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:32.539909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a2beaff3-e85d-4243-9fe0-0de59a647d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:32.554449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 746/1486] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:39:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:32.594079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561669f-1521-4e64-b75e-1c576a3c0a67 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:32.606059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7561669f-1521-4e64-b75e-1c576a3c0a67 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:32.610581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084b871-83f2-4d8d-a50c-8b4211c7a68e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:32.611274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084b871-83f2-4d8d-a50c-8b4211c7a68e service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:32.611537 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084b871-83f2-4d8d-a50c-8b4211c7a68e service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:32.611825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084b871-83f2-4d8d-a50c-8b4211c7a68e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:32.622597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084b871-83f2-4d8d-a50c-8b4211c7a68e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:32.624152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084b871-83f2-4d8d-a50c-8b4211c7a68e service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:32.637435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 741/1487] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:35.005194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce1df4-1675-4cf4-85da-90024a54a471 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:35.005870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce1df4-1675-4cf4-85da-90024a54a471 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:35.005870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce1df4-1675-4cf4-85da-90024a54a471 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:35.007191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 747/1488] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:35.012640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a824514-0948-421e-9150-2fc602023b88 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:35.013053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a824514-0948-421e-9150-2fc602023b88 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:35.013207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a824514-0948-421e-9150-2fc602023b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:35.031039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9a824514-0948-421e-9150-2fc602023b88 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:35.032250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9a824514-0948-421e-9150-2fc602023b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:35.040185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 742/1489] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:35.080536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce1df4-1675-4cf4-85da-90024a54a471 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:35.091505 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce1df4-1675-4cf4-85da-90024a54a471 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:35.095562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb28802-92ff-47bb-9849-a5734d040dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:35.096203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb28802-92ff-47bb-9849-a5734d040dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:35.096488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb28802-92ff-47bb-9849-a5734d040dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:35.096767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb28802-92ff-47bb-9849-a5734d040dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:35.106307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb28802-92ff-47bb-9849-a5734d040dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:35.108005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb28802-92ff-47bb-9849-a5734d040dbd service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:35.118962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 748/1490] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:37.930397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06eac0-8086-4918-a6e2-2c1b07e30b8c None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:37.931068 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06eac0-8086-4918-a6e2-2c1b07e30b8c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:37.931312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea06eac0-8086-4918-a6e2-2c1b07e30b8c None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:37.933020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 743/1491] 10.222.0.41 () {54 vars in 926 bytes} [Thu May 26 12:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:39:37.940203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ce375-6c59-4032-8207-fd348527bf0d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:37.940731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ce375-6c59-4032-8207-fd348527bf0d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:37.941036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ce375-6c59-4032-8207-fd348527bf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:37.959841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ea7ce375-6c59-4032-8207-fd348527bf0d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:37.961213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ea7ce375-6c59-4032-8207-fd348527bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:37.969612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 749/1492] 10.222.0.41 () {58 vars in 1023 bytes} [Thu May 26 12:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:38.012964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06eac0-8086-4918-a6e2-2c1b07e30b8c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:38.029737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea06eac0-8086-4918-a6e2-2c1b07e30b8c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:38.034149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afea35-850c-4631-aecf-6cb47d003d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:38.034884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afea35-850c-4631-aecf-6cb47d003d01 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:38.035256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afea35-850c-4631-aecf-6cb47d003d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:38.035550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afea35-850c-4631-aecf-6cb47d003d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:38.046695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61afea35-850c-4631-aecf-6cb47d003d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:38.048137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61afea35-850c-4631-aecf-6cb47d003d01 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:38.058881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 744/1493] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:47.954321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=33 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:48.053756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=33 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:07.852001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546297fe-29d2-4cb8-a040-6fe6cdae8260 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:07.852568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546297fe-29d2-4cb8-a040-6fe6cdae8260 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:07.852568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546297fe-29d2-4cb8-a040-6fe6cdae8260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:07.871812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-546297fe-29d2-4cb8-a040-6fe6cdae8260 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:07.873047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-546297fe-29d2-4cb8-a040-6fe6cdae8260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:07.882136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 750/1494] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:07.891637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54388-9c97-462b-a246-47a4e28f9456 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:07.892158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54388-9c97-462b-a246-47a4e28f9456 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:07.892308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a54388-9c97-462b-a246-47a4e28f9456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:07.911994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-96a54388-9c97-462b-a246-47a4e28f9456 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:07.913200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-96a54388-9c97-462b-a246-47a4e28f9456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:07.921591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 745/1495] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:07.926567 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546297fe-29d2-4cb8-a040-6fe6cdae8260 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:07.937732 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546297fe-29d2-4cb8-a040-6fe6cdae8260 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:07.942771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361683-efb9-4a32-9170-f6563157d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:07.943447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361683-efb9-4a32-9170-f6563157d0ef admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:07.943731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361683-efb9-4a32-9170-f6563157d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:07.944013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45361683-efb9-4a32-9170-f6563157d0ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:07.944747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45361683-efb9-4a32-9170-f6563157d0ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:42:07.945296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45361683-efb9-4a32-9170-f6563157d0ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:07.946137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: WARNING py.warnings [None req-45361683-efb9-4a32-9170-f6563157d0ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:42:07.946137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: warnings.warn(msg) May 26 12:42:07.946137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: May 26 12:42:07.947029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45361683-efb9-4a32-9170-f6563157d0ef admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:07.961049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 751/1496] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:42:07.970222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a54388-9c97-462b-a246-47a4e28f9456 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:07.979936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a54388-9c97-462b-a246-47a4e28f9456 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:07.989548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432837a8-ce7a-405b-90a1-7f0ab8e6793b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:07.990367 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432837a8-ce7a-405b-90a1-7f0ab8e6793b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:07.990654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432837a8-ce7a-405b-90a1-7f0ab8e6793b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:07.990938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432837a8-ce7a-405b-90a1-7f0ab8e6793b admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:07.991954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432837a8-ce7a-405b-90a1-7f0ab8e6793b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:07.994048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-432837a8-ce7a-405b-90a1-7f0ab8e6793b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:42:07.994048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: warnings.warn(msg) May 26 12:42:07.994048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: May 26 12:42:07.995448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432837a8-ce7a-405b-90a1-7f0ab8e6793b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.171686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 746/1497] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:42:07 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:42:08.176063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361683-efb9-4a32-9170-f6563157d0ef admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.186106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45361683-efb9-4a32-9170-f6563157d0ef admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.258289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8b627-5e8a-4504-92d5-bd449f05dbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.258988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8b627-5e8a-4504-92d5-bd449f05dbad admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.259270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8b627-5e8a-4504-92d5-bd449f05dbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.259543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8b627-5e8a-4504-92d5-bd449f05dbad admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.260799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8b627-5e8a-4504-92d5-bd449f05dbad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.261841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: WARNING py.warnings [None req-a7a8b627-5e8a-4504-92d5-bd449f05dbad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:42:08.261841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: warnings.warn(msg) May 26 12:42:08.261841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: May 26 12:42:08.263078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a8b627-5e8a-4504-92d5-bd449f05dbad admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.352920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 752/1498] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:42:08 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:42:08.359489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432837a8-ce7a-405b-90a1-7f0ab8e6793b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.372740 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432837a8-ce7a-405b-90a1-7f0ab8e6793b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.377644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b10c0-a1a4-43f3-9638-f20e0a6c16cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.378353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b10c0-a1a4-43f3-9638-f20e0a6c16cb admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.378641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b10c0-a1a4-43f3-9638-f20e0a6c16cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.378931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b10c0-a1a4-43f3-9638-f20e0a6c16cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.379663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b10c0-a1a4-43f3-9638-f20e0a6c16cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.380680 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-930b10c0-a1a4-43f3-9638-f20e0a6c16cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:42:08.380680 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: warnings.warn(msg) May 26 12:42:08.380680 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: May 26 12:42:08.381582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930b10c0-a1a4-43f3-9638-f20e0a6c16cb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.396255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 747/1499] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:42:08.401221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8b627-5e8a-4504-92d5-bd449f05dbad admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.412111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8b627-5e8a-4504-92d5-bd449f05dbad admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.419221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5a7cf-b380-4373-b509-531dcf937c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.419915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a7cf-b380-4373-b509-531dcf937c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.420208 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a7cf-b380-4373-b509-531dcf937c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.420495 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5a7cf-b380-4373-b509-531dcf937c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.421244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5a7cf-b380-4373-b509-531dcf937c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.422379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: WARNING py.warnings [None req-ffe5a7cf-b380-4373-b509-531dcf937c25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:42:08.422379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: warnings.warn(msg) May 26 12:42:08.422379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: May 26 12:42:08.423224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5a7cf-b380-4373-b509-531dcf937c25 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.438123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 753/1500] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:42:08.442893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b10c0-a1a4-43f3-9638-f20e0a6c16cb admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.454056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b10c0-a1a4-43f3-9638-f20e0a6c16cb admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.459031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7b0a1-9b33-47d1-a3b5-9c4f16a38500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.460000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7b0a1-9b33-47d1-a3b5-9c4f16a38500 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.460289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7b0a1-9b33-47d1-a3b5-9c4f16a38500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.460598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7b0a1-9b33-47d1-a3b5-9c4f16a38500 admin admin] PATH_INFO: `/v3/projects/865888c7aae5464bac598c60a0aecbf1/users/95972d0d94654efe80f269ef7323d97c/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.479001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7b0a1-9b33-47d1-a3b5-9c4f16a38500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=865888c7aae5464bac598c60a0aecbf1, user_id=95972d0d94654efe80f269ef7323d97c, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.480046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-81e7b0a1-9b33-47d1-a3b5-9c4f16a38500 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:42:08.480046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: warnings.warn(msg) May 26 12:42:08.480046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: May 26 12:42:08.482016 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7b0a1-9b33-47d1-a3b5-9c4f16a38500 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.559798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 748/1501] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:42:08 2022] PUT /identity/v3/projects/865888c7aae5464bac598c60a0aecbf1/users/95972d0d94654efe80f269ef7323d97c/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:08.571836 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3f66b-0efa-462e-8c27-6b1b4bcc3d7b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.572391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3f66b-0efa-462e-8c27-6b1b4bcc3d7b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.573837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb3f66b-0efa-462e-8c27-6b1b4bcc3d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.604858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9eb3f66b-0efa-462e-8c27-6b1b4bcc3d7b None None] MFA Rules not processed for user `95972d0d94654efe80f269ef7323d97c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:08.606317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9eb3f66b-0efa-462e-8c27-6b1b4bcc3d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:08.677537 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 754/1502] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:08.692568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620985de-07b3-4b48-b156-ecfa7d5e97df None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.692840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620985de-07b3-4b48-b156-ecfa7d5e97df None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.693122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620985de-07b3-4b48-b156-ecfa7d5e97df None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.694579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 749/1503] 10.222.0.41 () {54 vars in 963 bytes} [Thu May 26 12:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:42:08.701118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e8e9f-6b15-4b65-8c5e-b2180a839519 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.701616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e8e9f-6b15-4b65-8c5e-b2180a839519 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.702182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e8e9f-6b15-4b65-8c5e-b2180a839519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.732423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6f8e8e9f-6b15-4b65-8c5e-b2180a839519 None None] MFA Rules not processed for user `395e7e721bf349f2bee876a23fc12291`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:08.734548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6f8e8e9f-6b15-4b65-8c5e-b2180a839519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:08.797296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:08.804559 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 755/1504] 10.222.0.41 () {58 vars in 1060 bytes} [Thu May 26 12:42:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:08.812938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620985de-07b3-4b48-b156-ecfa7d5e97df None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.824503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620985de-07b3-4b48-b156-ecfa7d5e97df None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.828077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53767e25-c9c2-4609-8491-c8462c45c8da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.828715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53767e25-c9c2-4609-8491-c8462c45c8da service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.829001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53767e25-c9c2-4609-8491-c8462c45c8da service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.829280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53767e25-c9c2-4609-8491-c8462c45c8da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.837756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53767e25-c9c2-4609-8491-c8462c45c8da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.839222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53767e25-c9c2-4609-8491-c8462c45c8da service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:08.848479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 750/1505] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:42:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:08.895088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8ee83-86ef-41ec-96e9-7ee64c7c3448 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.895576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8ee83-86ef-41ec-96e9-7ee64c7c3448 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.895696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8ee83-86ef-41ec-96e9-7ee64c7c3448 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.896926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 756/1506] 10.222.0.41 () {52 vars in 829 bytes} [Thu May 26 12:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:42:08.900724 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53767e25-c9c2-4609-8491-c8462c45c8da service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:08.969687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53767e25-c9c2-4609-8491-c8462c45c8da service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:08.974345 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:08.975222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:08.975507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:08.975787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] PATH_INFO: `/v3/users/95972d0d94654efe80f269ef7323d97c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:08.976981 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=95972d0d94654efe80f269ef7323d97c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:08.978032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:42:08.978032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: warnings.warn(msg) May 26 12:42:08.978032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: May 26 12:42:08.980030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:09.257581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95972d0d94654efe80f269ef7323d97c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:09.575348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95972d0d94654efe80f269ef7323d97c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:09.576035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95972d0d94654efe80f269ef7323d97c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:09.576662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95972d0d94654efe80f269ef7323d97c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:09.598617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95972d0d94654efe80f269ef7323d97c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:09.608116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:09.620119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 751/1507] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:42:08 2022] DELETE /identity/v3/users/95972d0d94654efe80f269ef7323d97c => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:09.624574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fa1f-4554-4892-ad1c-d584f6552cd8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:09.624864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fa1f-4554-4892-ad1c-d584f6552cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:09.625149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185fa1f-4554-4892-ad1c-d584f6552cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:09.644016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8185fa1f-4554-4892-ad1c-d584f6552cd8 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:42:09.645239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8185fa1f-4554-4892-ad1c-d584f6552cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:09.708555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 757/1508] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:42:09.719632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:09.721130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:09.780614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc6d69-fe31-4b55-a9a2-78155ca79fda admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:09.784381 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bddd17-b0b6-48d2-ad06-69a1e4977672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:09.785040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bddd17-b0b6-48d2-ad06-69a1e4977672 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:09.785329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bddd17-b0b6-48d2-ad06-69a1e4977672 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:09.785612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bddd17-b0b6-48d2-ad06-69a1e4977672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:09.795246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bddd17-b0b6-48d2-ad06-69a1e4977672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:09.802575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bddd17-b0b6-48d2-ad06-69a1e4977672 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:09.806731 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 752/1509] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:42:10.434764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185fa1f-4554-4892-ad1c-d584f6552cd8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:42:10.436360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8185fa1f-4554-4892-ad1c-d584f6552cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:42:10.449784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185fa1f-4554-4892-ad1c-d584f6552cd8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:42:10.457025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:42:10.457973 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:42:10.458257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:42:10.458535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] PATH_INFO: `/v3/projects/865888c7aae5464bac598c60a0aecbf1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:42:10.459809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=865888c7aae5464bac598c60a0aecbf1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:42:10.461493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: WARNING py.warnings [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:42:10.461493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: warnings.warn(msg) May 26 12:42:10.461493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: May 26 12:42:10.462928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:42:10.626920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865888c7aae5464bac598c60a0aecbf1', 'request_id': 'req-cc8614f1-aac4-4585-923c-1f3c6d35ca88'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:10.633413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865888c7aae5464bac598c60a0aecbf1', 'request_id': 'req-cc8614f1-aac4-4585-923c-1f3c6d35ca88'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:10.647326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865888c7aae5464bac598c60a0aecbf1', 'request_id': 'req-cc8614f1-aac4-4585-923c-1f3c6d35ca88'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:10.712031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] The token cache is being invalidate because project 865888c7aae5464bac598c60a0aecbf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:42:10.712313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:10.712957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc8614f1-aac4-4585-923c-1f3c6d35ca88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:42:10.715187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 758/1510] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:42:10 2022] DELETE /identity/v3/projects/865888c7aae5464bac598c60a0aecbf1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:42:19.883921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=29 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:42:20.708721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:55.838621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05a5d4-313c-4cb7-9c9c-3e13281992cf None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:55.839225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05a5d4-313c-4cb7-9c9c-3e13281992cf None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:55.839225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05a5d4-313c-4cb7-9c9c-3e13281992cf None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:55.840579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:43:55.845833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238285f-239e-459e-8516-bd88edde6da3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:55.846326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238285f-239e-459e-8516-bd88edde6da3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:55.846432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238285f-239e-459e-8516-bd88edde6da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:55.864660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c238285f-239e-459e-8516-bd88edde6da3 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:55.865913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c238285f-239e-459e-8516-bd88edde6da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:55.927536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:56.103414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05a5d4-313c-4cb7-9c9c-3e13281992cf None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:56.105109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-dc05a5d4-313c-4cb7-9c9c-3e13281992cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:56.192884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05a5d4-313c-4cb7-9c9c-3e13281992cf None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:56.198522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdabb50-88ed-451d-8b48-7ad8dc34ee58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:56.199210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabb50-88ed-451d-8b48-7ad8dc34ee58 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:56.199493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabb50-88ed-451d-8b48-7ad8dc34ee58 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:56.199887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdabb50-88ed-451d-8b48-7ad8dc34ee58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:56.209015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdabb50-88ed-451d-8b48-7ad8dc34ee58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:56.211056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdabb50-88ed-451d-8b48-7ad8dc34ee58 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:56.221528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 754/1513] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:56.929272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9bf91-40e5-4b3e-85d3-fa48a8e48703 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:56.930707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9bf91-40e5-4b3e-85d3-fa48a8e48703 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:56.930707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9bf91-40e5-4b3e-85d3-fa48a8e48703 None None] PATH_INFO: `/v3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:56.932421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 760/1514] 10.222.0.42 () {54 vars in 925 bytes} [Thu May 26 12:43:56 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:43:56.941466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a757d-7a40-483c-b407-f20f80c97070 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:56.942074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a757d-7a40-483c-b407-f20f80c97070 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:56.942209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a757d-7a40-483c-b407-f20f80c97070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:56.960691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-161a757d-7a40-483c-b407-f20f80c97070 None None] MFA Rules not processed for user `0412209ee10a46558a8baf10b59f89a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:56.961964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-161a757d-7a40-483c-b407-f20f80c97070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:57.027787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 755/1515] 10.222.0.42 () {58 vars in 1015 bytes} [Thu May 26 12:43:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:57.119332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57b7b9-c94b-44af-8ef2-e8d00d52abdb None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:57.119618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57b7b9-c94b-44af-8ef2-e8d00d52abdb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:57.119894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca57b7b9-c94b-44af-8ef2-e8d00d52abdb None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:57.121296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 761/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:43:57.126393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd87fe-0f0b-4fe9-b737-9ad1ca5fc8af None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:57.126691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd87fe-0f0b-4fe9-b737-9ad1ca5fc8af None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:57.126976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd87fe-0f0b-4fe9-b737-9ad1ca5fc8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:57.144981 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-14dd87fe-0f0b-4fe9-b737-9ad1ca5fc8af None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:57.146295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-14dd87fe-0f0b-4fe9-b737-9ad1ca5fc8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:57.154961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 756/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:57.306684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57b7b9-c94b-44af-8ef2-e8d00d52abdb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:57.321275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca57b7b9-c94b-44af-8ef2-e8d00d52abdb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:57.326980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630ae39-a2a0-4ef8-911b-80077b7197d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:57.327612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ae39-a2a0-4ef8-911b-80077b7197d6 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:57.327901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ae39-a2a0-4ef8-911b-80077b7197d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:57.328177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630ae39-a2a0-4ef8-911b-80077b7197d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:57.337058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630ae39-a2a0-4ef8-911b-80077b7197d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:57.338684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630ae39-a2a0-4ef8-911b-80077b7197d6 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:57.348475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 762/1518] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:01.264784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677527b-1779-40cd-9ff0-c87c3507e0fa None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.265344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677527b-1779-40cd-9ff0-c87c3507e0fa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.265344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677527b-1779-40cd-9ff0-c87c3507e0fa None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.266777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 757/1519] 10.222.0.41 () {54 vars in 960 bytes} [Thu May 26 12:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:44:01.271859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a85f0-af6e-4dd2-bf60-3d8ffc31bd9c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.272265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a85f0-af6e-4dd2-bf60-3d8ffc31bd9c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.272416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a85f0-af6e-4dd2-bf60-3d8ffc31bd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.291434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-932a85f0-af6e-4dd2-bf60-3d8ffc31bd9c None None] MFA Rules not processed for user `0412209ee10a46558a8baf10b59f89a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:01.292660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-932a85f0-af6e-4dd2-bf60-3d8ffc31bd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:01.301354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 763/1520] 10.222.0.41 () {58 vars in 1057 bytes} [Thu May 26 12:44:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:01.309584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677527b-1779-40cd-9ff0-c87c3507e0fa None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:01.323931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677527b-1779-40cd-9ff0-c87c3507e0fa None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:01.328901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ff876-181e-4ead-9599-b149897f1e6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:01.329559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ff876-181e-4ead-9599-b149897f1e6d service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:01.329859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ff876-181e-4ead-9599-b149897f1e6d service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:01.330141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ff876-181e-4ead-9599-b149897f1e6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:01.345032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ff876-181e-4ead-9599-b149897f1e6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:01.345032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ff876-181e-4ead-9599-b149897f1e6d service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:01.350588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 758/1521] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:44:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:08.664023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c5d2e-0c80-409c-a13e-aad7c1b59e7c None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:08.664617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c5d2e-0c80-409c-a13e-aad7c1b59e7c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:08.664617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c5d2e-0c80-409c-a13e-aad7c1b59e7c None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:08.665946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:44:08.671660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a00f-1f31-472f-aab4-f1cfa73ab6fb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:08.672066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a00f-1f31-472f-aab4-f1cfa73ab6fb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:08.672226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a00f-1f31-472f-aab4-f1cfa73ab6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:08.690691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0334a00f-1f31-472f-aab4-f1cfa73ab6fb None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:08.691923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0334a00f-1f31-472f-aab4-f1cfa73ab6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:08.700349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:08.855793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c5d2e-0c80-409c-a13e-aad7c1b59e7c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:08.872409 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c5d2e-0c80-409c-a13e-aad7c1b59e7c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:08.878679 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac96ee-6e6b-4d07-9081-e4a0a7f86cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:08.879357 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac96ee-6e6b-4d07-9081-e4a0a7f86cc7 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:08.879637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac96ee-6e6b-4d07-9081-e4a0a7f86cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:08.879915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac96ee-6e6b-4d07-9081-e4a0a7f86cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:08.889095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac96ee-6e6b-4d07-9081-e4a0a7f86cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:08.890840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac96ee-6e6b-4d07-9081-e4a0a7f86cc7 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:08.901265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 765/1524] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:09.793114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0810aa-235f-4b4a-ba8f-9d1291bcf6de None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:09.793808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0810aa-235f-4b4a-ba8f-9d1291bcf6de None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:09.793808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0810aa-235f-4b4a-ba8f-9d1291bcf6de None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:09.795141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:44:09.801153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687eff70-3131-4037-8576-effecad3fc5e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:09.801703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687eff70-3131-4037-8576-effecad3fc5e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:09.801828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687eff70-3131-4037-8576-effecad3fc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:09.832145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-687eff70-3131-4037-8576-effecad3fc5e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:09.833879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-687eff70-3131-4037-8576-effecad3fc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:09.844968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:10.000467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0810aa-235f-4b4a-ba8f-9d1291bcf6de None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:10.015530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0810aa-235f-4b4a-ba8f-9d1291bcf6de None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:10.021062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd2a09-27bc-4326-8121-2253ac716efd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:10.021738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd2a09-27bc-4326-8121-2253ac716efd service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:10.022028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd2a09-27bc-4326-8121-2253ac716efd service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:10.022310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd2a09-27bc-4326-8121-2253ac716efd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:10.030951 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd2a09-27bc-4326-8121-2253ac716efd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:10.032544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd2a09-27bc-4326-8121-2253ac716efd service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:10.042684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 761/1527] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:14.308795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b650ed1-741e-42e1-acb4-e8de9555ff02 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:14.309358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b650ed1-741e-42e1-acb4-e8de9555ff02 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:14.309358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b650ed1-741e-42e1-acb4-e8de9555ff02 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:14.310763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:44:14.315958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53065251-5e98-4686-a5cc-45986715db96 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:14.316444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53065251-5e98-4686-a5cc-45986715db96 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:14.316554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53065251-5e98-4686-a5cc-45986715db96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:14.335668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-53065251-5e98-4686-a5cc-45986715db96 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:14.337322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-53065251-5e98-4686-a5cc-45986715db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:14.345206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:14.382764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b650ed1-741e-42e1-acb4-e8de9555ff02 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:14.384537 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7b650ed1-741e-42e1-acb4-e8de9555ff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:14.445913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b650ed1-741e-42e1-acb4-e8de9555ff02 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:14.449551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb9b96-f5de-4359-b825-16fa0f3ba40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:14.450254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9b96-f5de-4359-b825-16fa0f3ba40a service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:14.450565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9b96-f5de-4359-b825-16fa0f3ba40a service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:14.450840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb9b96-f5de-4359-b825-16fa0f3ba40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:14.460206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb9b96-f5de-4359-b825-16fa0f3ba40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:14.462316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb9b96-f5de-4359-b825-16fa0f3ba40a service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:14.472138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 768/1530] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:16.675436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddb59d-cd17-4936-82c9-4aca89cb2d2a None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.675968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddb59d-cd17-4936-82c9-4aca89cb2d2a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.676083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddb59d-cd17-4936-82c9-4aca89cb2d2a None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.677369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:44:16.683578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f15ce-f464-4680-b80f-cd4907de862d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.684024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f15ce-f464-4680-b80f-cd4907de862d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.684116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f15ce-f464-4680-b80f-cd4907de862d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.702543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-952f15ce-f464-4680-b80f-cd4907de862d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:16.706357 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-952f15ce-f464-4680-b80f-cd4907de862d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:16.711710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:16.747915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddb59d-cd17-4936-82c9-4aca89cb2d2a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:16.749786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-14ddb59d-cd17-4936-82c9-4aca89cb2d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:16.763610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddb59d-cd17-4936-82c9-4aca89cb2d2a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:16.767164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6a8f0-d7b0-4b2b-b24e-dd8e6cce4a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:16.767797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a8f0-d7b0-4b2b-b24e-dd8e6cce4a74 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:16.768084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a8f0-d7b0-4b2b-b24e-dd8e6cce4a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:16.768364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6a8f0-d7b0-4b2b-b24e-dd8e6cce4a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:16.777720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6a8f0-d7b0-4b2b-b24e-dd8e6cce4a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:16.779156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6a8f0-d7b0-4b2b-b24e-dd8e6cce4a74 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:16.789086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 764/1533] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:20.433514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc14d3-56d2-4409-ac3a-b3cb3096b809 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:20.434112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc14d3-56d2-4409-ac3a-b3cb3096b809 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:20.434112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc14d3-56d2-4409-ac3a-b3cb3096b809 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:20.435469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:44:20.441141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df54896-39cd-490a-838e-81dfedd96017 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:20.441723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df54896-39cd-490a-838e-81dfedd96017 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:20.441723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df54896-39cd-490a-838e-81dfedd96017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:20.448636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:20.460915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-1df54896-39cd-490a-838e-81dfedd96017 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:20.467057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1df54896-39cd-490a-838e-81dfedd96017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:20.471097 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:20.751353 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc14d3-56d2-4409-ac3a-b3cb3096b809 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:20.753118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d5bc14d3-56d2-4409-ac3a-b3cb3096b809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:20.813637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc14d3-56d2-4409-ac3a-b3cb3096b809 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:20.817922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82ba78-ad14-45b7-bb00-ad22b2bd1da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:20.822683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ba78-ad14-45b7-bb00-ad22b2bd1da6 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:20.822683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ba78-ad14-45b7-bb00-ad22b2bd1da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:20.822683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ba78-ad14-45b7-bb00-ad22b2bd1da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:20.829265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82ba78-ad14-45b7-bb00-ad22b2bd1da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:20.830709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82ba78-ad14-45b7-bb00-ad22b2bd1da6 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:20.838492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:20.843153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 771/1536] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:44:23.109884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857575a3-2d1e-4b56-9f67-0834f36f4f74 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:23.110455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857575a3-2d1e-4b56-9f67-0834f36f4f74 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:23.110455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857575a3-2d1e-4b56-9f67-0834f36f4f74 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:23.111844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:44:23.117121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f9b9-674a-407d-8cf1-c957b4858b41 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:23.117572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f9b9-674a-407d-8cf1-c957b4858b41 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:23.117686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1f9b9-674a-407d-8cf1-c957b4858b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:23.136290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fac1f9b9-674a-407d-8cf1-c957b4858b41 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:44:23.137501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fac1f9b9-674a-407d-8cf1-c957b4858b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:23.145744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:44:23.421446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857575a3-2d1e-4b56-9f67-0834f36f4f74 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:44:23.423275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-857575a3-2d1e-4b56-9f67-0834f36f4f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:44:23.436875 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857575a3-2d1e-4b56-9f67-0834f36f4f74 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:44:23.440524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00231231-f624-4a7c-8aa1-4fa469c1dd7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:44:23.441321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00231231-f624-4a7c-8aa1-4fa469c1dd7e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:44:23.441608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00231231-f624-4a7c-8aa1-4fa469c1dd7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:44:23.441914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00231231-f624-4a7c-8aa1-4fa469c1dd7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:44:23.453707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00231231-f624-4a7c-8aa1-4fa469c1dd7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:44:23.455156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00231231-f624-4a7c-8aa1-4fa469c1dd7e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:44:23.465693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 767/1539] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:44:33.130714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:44:33.460734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=8 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:55.570856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90283c-d404-440b-8347-444991ba821c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:55.572628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90283c-d404-440b-8347-444991ba821c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:55.573279 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90283c-d404-440b-8347-444991ba821c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:55.599035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2f90283c-d404-440b-8347-444991ba821c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:55.600334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2f90283c-d404-440b-8347-444991ba821c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:55.615024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 773/1540] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:55.634043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc380-2187-4987-aa23-bf06811806da None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:55.635332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc380-2187-4987-aa23-bf06811806da None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:55.635905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bc380-2187-4987-aa23-bf06811806da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:55.674101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e25bc380-2187-4987-aa23-bf06811806da None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:55.675830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e25bc380-2187-4987-aa23-bf06811806da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:55.693206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 768/1541] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:55.700359 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90283c-d404-440b-8347-444991ba821c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:55.711936 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90283c-d404-440b-8347-444991ba821c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:55.722632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c332-95c6-444c-bd33-0287c4a4a884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:55.723638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c332-95c6-444c-bd33-0287c4a4a884 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:55.724122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c332-95c6-444c-bd33-0287c4a4a884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:55.724579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f6c332-95c6-444c-bd33-0287c4a4a884 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:55.725491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6c332-95c6-444c-bd33-0287c4a4a884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:55.726261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6c332-95c6-444c-bd33-0287c4a4a884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:55.728315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f6c332-95c6-444c-bd33-0287c4a4a884 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:55.749306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 774/1542] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:55.755978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd87b0-588a-456f-a766-bd706a06250a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:55.756823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd87b0-588a-456f-a766-bd706a06250a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:55.757354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd87b0-588a-456f-a766-bd706a06250a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:55.763614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c332-95c6-444c-bd33-0287c4a4a884 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:55.784469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f6c332-95c6-444c-bd33-0287c4a4a884 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:55.798707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee37fa9-decf-4b73-a7c9-8ab54f5fe0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:55.799695 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee37fa9-decf-4b73-a7c9-8ab54f5fe0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:55.799986 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee37fa9-decf-4b73-a7c9-8ab54f5fe0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:55.800269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee37fa9-decf-4b73-a7c9-8ab54f5fe0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:55.801148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4fcd87b0-588a-456f-a766-bd706a06250a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:55.801305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee37fa9-decf-4b73-a7c9-8ab54f5fe0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:55.802345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: WARNING py.warnings [None req-bee37fa9-decf-4b73-a7c9-8ab54f5fe0c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:45:55.802345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: warnings.warn(msg) May 26 12:45:55.802345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: May 26 12:45:55.803363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4fcd87b0-588a-456f-a766-bd706a06250a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:55.803864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee37fa9-decf-4b73-a7c9-8ab54f5fe0c7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:55.833423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 769/1543] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:55.851368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed8a9d-753f-4b02-8ee7-ce4493571706 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:55.852803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed8a9d-753f-4b02-8ee7-ce4493571706 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:55.853498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed8a9d-753f-4b02-8ee7-ce4493571706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:55.905229 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-cfed8a9d-753f-4b02-8ee7-ce4493571706 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:55.907869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cfed8a9d-753f-4b02-8ee7-ce4493571706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:55.926148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 770/1544] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:55.927998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac938d-c313-4010-a113-108af089c866 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:55.928577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac938d-c313-4010-a113-108af089c866 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:55.929051 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac938d-c313-4010-a113-108af089c866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:55.963068 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-79ac938d-c313-4010-a113-108af089c866 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:55.965083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-79ac938d-c313-4010-a113-108af089c866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:55.980816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 771/1546] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:55.981046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 775/1546] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:45:55 2022] POST /identity/v3/projects => generated 365 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:55.981998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee37fa9-decf-4b73-a7c9-8ab54f5fe0c7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:55.982950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818b84-df3d-4826-8631-d73d29b8c533 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:55.989108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818b84-df3d-4826-8631-d73d29b8c533 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:55.989108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27818b84-df3d-4826-8631-d73d29b8c533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.027722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-27818b84-df3d-4826-8631-d73d29b8c533 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.030181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-27818b84-df3d-4826-8631-d73d29b8c533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.096731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee37fa9-decf-4b73-a7c9-8ab54f5fe0c7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.110760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955331c-c3eb-41cd-a76a-31ad0825890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.111451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955331c-c3eb-41cd-a76a-31ad0825890f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.111750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955331c-c3eb-41cd-a76a-31ad0825890f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.112029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955331c-c3eb-41cd-a76a-31ad0825890f admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.112783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955331c-c3eb-41cd-a76a-31ad0825890f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:56.113098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955331c-c3eb-41cd-a76a-31ad0825890f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.120565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955331c-c3eb-41cd-a76a-31ad0825890f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.137697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 776/1547] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:45:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:56.138965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955331c-c3eb-41cd-a76a-31ad0825890f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.152871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955331c-c3eb-41cd-a76a-31ad0825890f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.159094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37541b-d344-44a4-b242-5e12ee1ffc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.159792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37541b-d344-44a4-b242-5e12ee1ffc24 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.160082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37541b-d344-44a4-b242-5e12ee1ffc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.160392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37541b-d344-44a4-b242-5e12ee1ffc24 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.161136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37541b-d344-44a4-b242-5e12ee1ffc24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.163166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37541b-d344-44a4-b242-5e12ee1ffc24 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.182399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 772/1548] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.182399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27294d0f-3d76-4e20-928a-a3507215a87b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.182399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27294d0f-3d76-4e20-928a-a3507215a87b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.182399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27294d0f-3d76-4e20-928a-a3507215a87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.205185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-27294d0f-3d76-4e20-928a-a3507215a87b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.206466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-27294d0f-3d76-4e20-928a-a3507215a87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.215281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 773/1549] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.216650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7794-2763-447f-a21b-71225d58ac2f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.216941 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7794-2763-447f-a21b-71225d58ac2f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.217226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef7794-2763-447f-a21b-71225d58ac2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.237982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ffef7794-2763-447f-a21b-71225d58ac2f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.239684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ffef7794-2763-447f-a21b-71225d58ac2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.248171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 774/1550] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.249596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1066afc-5b3b-4d86-bdc8-31e9fd41c98d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.249936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1066afc-5b3b-4d86-bdc8-31e9fd41c98d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.250220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1066afc-5b3b-4d86-bdc8-31e9fd41c98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.270362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d1066afc-5b3b-4d86-bdc8-31e9fd41c98d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.271601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d1066afc-5b3b-4d86-bdc8-31e9fd41c98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.280596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 777/1552] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:56.280824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 775/1551] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.281420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37541b-d344-44a4-b242-5e12ee1ffc24 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.282059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae872f5-ba06-48be-8457-08987ce0e10f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.282359 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae872f5-ba06-48be-8457-08987ce0e10f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.282645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae872f5-ba06-48be-8457-08987ce0e10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.293415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37541b-d344-44a4-b242-5e12ee1ffc24 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.298306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fd567-fe8c-4f4d-9efc-b6565d7a864a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.299001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd567-fe8c-4f4d-9efc-b6565d7a864a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.299288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd567-fe8c-4f4d-9efc-b6565d7a864a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.299572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd567-fe8c-4f4d-9efc-b6565d7a864a admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.300277 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fd567-fe8c-4f4d-9efc-b6565d7a864a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.302270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fd567-fe8c-4f4d-9efc-b6565d7a864a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.307746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9ae872f5-ba06-48be-8457-08987ce0e10f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.309223 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9ae872f5-ba06-48be-8457-08987ce0e10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.319561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 776/1553] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.321809 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc93925-ca96-4c73-b39c-cd2b153ab9a1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.322288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc93925-ca96-4c73-b39c-cd2b153ab9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.322786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc93925-ca96-4c73-b39c-cd2b153ab9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.343131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8bc93925-ca96-4c73-b39c-cd2b153ab9a1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.344348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8bc93925-ca96-4c73-b39c-cd2b153ab9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.353683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 777/1554] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.354665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648dac-bb7d-4250-8598-152189fffc94 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.354948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648dac-bb7d-4250-8598-152189fffc94 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.355304 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07648dac-bb7d-4250-8598-152189fffc94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.374514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-07648dac-bb7d-4250-8598-152189fffc94 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.375791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-07648dac-bb7d-4250-8598-152189fffc94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.384113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 778/1555] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.384964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07648dac-bb7d-4250-8598-152189fffc94 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.395474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07648dac-bb7d-4250-8598-152189fffc94 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.401657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9193794-6eb0-4249-86ef-a1e64dccfa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.402373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9193794-6eb0-4249-86ef-a1e64dccfa1e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.402685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9193794-6eb0-4249-86ef-a1e64dccfa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.402968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9193794-6eb0-4249-86ef-a1e64dccfa1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.403870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9193794-6eb0-4249-86ef-a1e64dccfa1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:56.404039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 778/1556] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:56.404174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9193794-6eb0-4249-86ef-a1e64dccfa1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.405744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230974de-7cd2-46f5-b17a-0d088fc01147 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.415519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230974de-7cd2-46f5-b17a-0d088fc01147 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.415519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230974de-7cd2-46f5-b17a-0d088fc01147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.415752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-d9193794-6eb0-4249-86ef-a1e64dccfa1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:45:56.415752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: warnings.warn(msg) May 26 12:45:56.415752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: May 26 12:45:56.415752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9193794-6eb0-4249-86ef-a1e64dccfa1e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.429917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-230974de-7cd2-46f5-b17a-0d088fc01147 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.431322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-230974de-7cd2-46f5-b17a-0d088fc01147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.437167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 779/1557] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:56.437167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9193794-6eb0-4249-86ef-a1e64dccfa1e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.448745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9193794-6eb0-4249-86ef-a1e64dccfa1e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.504997 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 779/1558] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.507295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a299-e4dd-4751-a53f-ecabeedb97be None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.507295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a299-e4dd-4751-a53f-ecabeedb97be None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.507295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f6a299-e4dd-4751-a53f-ecabeedb97be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.515096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23df14-1bb5-4966-a28a-5bdcb7ef29ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.515843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23df14-1bb5-4966-a28a-5bdcb7ef29ee admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.516119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23df14-1bb5-4966-a28a-5bdcb7ef29ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.516397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23df14-1bb5-4966-a28a-5bdcb7ef29ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.517150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23df14-1bb5-4966-a28a-5bdcb7ef29ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.518827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23df14-1bb5-4966-a28a-5bdcb7ef29ee admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.527032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c4f6a299-e4dd-4751-a53f-ecabeedb97be None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.528264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c4f6a299-e4dd-4751-a53f-ecabeedb97be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.533470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 780/1559] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:56.533470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942df3-92e0-43e4-b327-c83074df7761 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.533470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942df3-92e0-43e4-b327-c83074df7761 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.533470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942df3-92e0-43e4-b327-c83074df7761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.541068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 780/1560] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.545053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6a299-e4dd-4751-a53f-ecabeedb97be None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.552541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f6a299-e4dd-4751-a53f-ecabeedb97be None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.555227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f6942df3-92e0-43e4-b327-c83074df7761 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.556498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f6942df3-92e0-43e4-b327-c83074df7761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.557441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad8356-bdd9-4fbe-8fea-0ece434f02f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.558167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad8356-bdd9-4fbe-8fea-0ece434f02f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.558458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad8356-bdd9-4fbe-8fea-0ece434f02f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.558742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad8356-bdd9-4fbe-8fea-0ece434f02f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.559475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad8356-bdd9-4fbe-8fea-0ece434f02f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:56.559780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad8356-bdd9-4fbe-8fea-0ece434f02f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.561435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad8356-bdd9-4fbe-8fea-0ece434f02f8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.563244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:56.566656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 781/1561] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.568247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64ba6-a1db-405c-b111-b5ea16854ca9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.568544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64ba6-a1db-405c-b111-b5ea16854ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.568823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f64ba6-a1db-405c-b111-b5ea16854ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.575646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 781/1562] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:56.582819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad8356-bdd9-4fbe-8fea-0ece434f02f8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.589467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-42f64ba6-a1db-405c-b111-b5ea16854ca9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:56.590789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-42f64ba6-a1db-405c-b111-b5ea16854ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:56.593748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad8356-bdd9-4fbe-8fea-0ece434f02f8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.598484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa5e61-3594-4eb0-96db-e64657456918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.598942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 782/1563] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:56.603844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa5e61-3594-4eb0-96db-e64657456918 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.603844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa5e61-3594-4eb0-96db-e64657456918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.603844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa5e61-3594-4eb0-96db-e64657456918 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.604137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64ba6-a1db-405c-b111-b5ea16854ca9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.604235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa5e61-3594-4eb0-96db-e64657456918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.604235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa5e61-3594-4eb0-96db-e64657456918 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.606820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:56.612091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f64ba6-a1db-405c-b111-b5ea16854ca9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.618777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27282b6-6edf-40b0-8e01-604ff9930aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.619489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27282b6-6edf-40b0-8e01-604ff9930aae admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.619779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27282b6-6edf-40b0-8e01-604ff9930aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.620101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27282b6-6edf-40b0-8e01-604ff9930aae admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.620941 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27282b6-6edf-40b0-8e01-604ff9930aae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.623190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27282b6-6edf-40b0-8e01-604ff9930aae admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.782707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 782/1564] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:56.783632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa5e61-3594-4eb0-96db-e64657456918 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.794079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa5e61-3594-4eb0-96db-e64657456918 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.803109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f41c02-7537-49fb-9599-faec83f2e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.803109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f41c02-7537-49fb-9599-faec83f2e9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.803109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f41c02-7537-49fb-9599-faec83f2e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.803109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f41c02-7537-49fb-9599-faec83f2e9c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.803711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f41c02-7537-49fb-9599-faec83f2e9c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:56.803711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f41c02-7537-49fb-9599-faec83f2e9c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.803711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f41c02-7537-49fb-9599-faec83f2e9c8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.814509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 783/1565] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:56.815316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f41c02-7537-49fb-9599-faec83f2e9c8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.826316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f41c02-7537-49fb-9599-faec83f2e9c8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.831403 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f507d-831f-4b67-a694-fee1328f5eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.832261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f507d-831f-4b67-a694-fee1328f5eca admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.832494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f507d-831f-4b67-a694-fee1328f5eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.832849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f507d-831f-4b67-a694-fee1328f5eca admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.833577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f507d-831f-4b67-a694-fee1328f5eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.835283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f507d-831f-4b67-a694-fee1328f5eca admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.840928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 783/1566] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:56.840928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27282b6-6edf-40b0-8e01-604ff9930aae admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.851108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 784/1567] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:56.851953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f507d-831f-4b67-a694-fee1328f5eca admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.861814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f507d-831f-4b67-a694-fee1328f5eca admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.918530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27282b6-6edf-40b0-8e01-604ff9930aae admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.923006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92768a-0ff6-4dc5-b31a-86565d24d315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.923714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92768a-0ff6-4dc5-b31a-86565d24d315 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.924016 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92768a-0ff6-4dc5-b31a-86565d24d315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.924294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92768a-0ff6-4dc5-b31a-86565d24d315 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.925078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92768a-0ff6-4dc5-b31a-86565d24d315 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:56.925331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92768a-0ff6-4dc5-b31a-86565d24d315 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.927063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92768a-0ff6-4dc5-b31a-86565d24d315 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.929225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb3dde-0278-4dea-923d-13970ce322aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.929931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb3dde-0278-4dea-923d-13970ce322aa admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.930215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb3dde-0278-4dea-923d-13970ce322aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.930487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb3dde-0278-4dea-923d-13970ce322aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.931222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb3dde-0278-4dea-923d-13970ce322aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:56.931532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb3dde-0278-4dea-923d-13970ce322aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.933226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb3dde-0278-4dea-923d-13970ce322aa admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.939638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 784/1568] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:56.940454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92768a-0ff6-4dc5-b31a-86565d24d315 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.951566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 785/1569] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:56.951566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb3dde-0278-4dea-923d-13970ce322aa admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:56.959327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb3dde-0278-4dea-923d-13970ce322aa admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.963436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92768a-0ff6-4dc5-b31a-86565d24d315 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:56.964631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27bc12-3675-41da-a991-e146f4119af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.965177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c49c3a-0797-4234-9382-dc2c813d5aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:56.965319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27bc12-3675-41da-a991-e146f4119af2 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.965572 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27bc12-3675-41da-a991-e146f4119af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.965903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27bc12-3675-41da-a991-e146f4119af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.966012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49c3a-0797-4234-9382-dc2c813d5aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:56.966187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49c3a-0797-4234-9382-dc2c813d5aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:56.966464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49c3a-0797-4234-9382-dc2c813d5aa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:56.966565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27bc12-3675-41da-a991-e146f4119af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.967186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49c3a-0797-4234-9382-dc2c813d5aa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:45:56.967492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49c3a-0797-4234-9382-dc2c813d5aa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:56.968483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27bc12-3675-41da-a991-e146f4119af2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.969121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49c3a-0797-4234-9382-dc2c813d5aa8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:56.997381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 786/1570] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:45:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:56.997381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c49c3a-0797-4234-9382-dc2c813d5aa8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.010193 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c49c3a-0797-4234-9382-dc2c813d5aa8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.014994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f585ff-1a90-4e59-a9b2-9f6870a07960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.015710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f585ff-1a90-4e59-a9b2-9f6870a07960 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.015999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f585ff-1a90-4e59-a9b2-9f6870a07960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.016280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f585ff-1a90-4e59-a9b2-9f6870a07960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.017010 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f585ff-1a90-4e59-a9b2-9f6870a07960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.018653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f585ff-1a90-4e59-a9b2-9f6870a07960 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.029895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 787/1571] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:57.032238 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f585ff-1a90-4e59-a9b2-9f6870a07960 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.040444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f585ff-1a90-4e59-a9b2-9f6870a07960 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.045804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db15c7-6c8d-4841-abde-c5b0e3f2dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.046462 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db15c7-6c8d-4841-abde-c5b0e3f2dc4d admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.046748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db15c7-6c8d-4841-abde-c5b0e3f2dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.047029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db15c7-6c8d-4841-abde-c5b0e3f2dc4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.047718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db15c7-6c8d-4841-abde-c5b0e3f2dc4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.049698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db15c7-6c8d-4841-abde-c5b0e3f2dc4d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.172889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 785/1572] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:45:56 2022] POST /identity/v3/projects => generated 403 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:57.173651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27bc12-3675-41da-a991-e146f4119af2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.234352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 788/1573] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:45:57 2022] POST /identity/v3/projects => generated 389 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:57.234352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db15c7-6c8d-4841-abde-c5b0e3f2dc4d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.236553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27bc12-3675-41da-a991-e146f4119af2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.294440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d2d06-7313-4962-825b-e7097ad131f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.295104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d2d06-7313-4962-825b-e7097ad131f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.295390 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d2d06-7313-4962-825b-e7097ad131f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.295716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d2d06-7313-4962-825b-e7097ad131f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.296398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d2d06-7313-4962-825b-e7097ad131f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.297410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-ed0d2d06-7313-4962-825b-e7097ad131f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:45:57.297410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: warnings.warn(msg) May 26 12:45:57.297410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: May 26 12:45:57.298643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d2d06-7313-4962-825b-e7097ad131f6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.299573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db15c7-6c8d-4841-abde-c5b0e3f2dc4d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.304847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47445cc7-dff3-4f51-8e78-7fd3e8f09730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.306324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445cc7-dff3-4f51-8e78-7fd3e8f09730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.306610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445cc7-dff3-4f51-8e78-7fd3e8f09730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.307130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47445cc7-dff3-4f51-8e78-7fd3e8f09730 admin admin] PATH_INFO: `/v3/projects/580cb4752e7342ff8939e1fafc00a160/users/57231ab43d4941a1b12a5171d1fff843/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.307240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:57.309556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:57.323849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47445cc7-dff3-4f51-8e78-7fd3e8f09730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=580cb4752e7342ff8939e1fafc00a160, user_id=57231ab43d4941a1b12a5171d1fff843, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.324905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: WARNING py.warnings [None req-47445cc7-dff3-4f51-8e78-7fd3e8f09730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:45:57.324905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: warnings.warn(msg) May 26 12:45:57.324905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: May 26 12:45:57.326890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47445cc7-dff3-4f51-8e78-7fd3e8f09730 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.485802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 789/1574] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:45:57 2022] PUT /identity/v3/projects/580cb4752e7342ff8939e1fafc00a160/users/57231ab43d4941a1b12a5171d1fff843/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:57.486427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 786/1575] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:45:57 2022] POST /identity/v3/users => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:57.487301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d2d06-7313-4962-825b-e7097ad131f6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.490246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47445cc7-dff3-4f51-8e78-7fd3e8f09730 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:57.498091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d2d06-7313-4962-825b-e7097ad131f6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.557526 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980be2-f9da-4332-85bd-2391c50baf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.558225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980be2-f9da-4332-85bd-2391c50baf12 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.558512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980be2-f9da-4332-85bd-2391c50baf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.558792 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e980be2-f9da-4332-85bd-2391c50baf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.559478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e980be2-f9da-4332-85bd-2391c50baf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.561267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47445cc7-dff3-4f51-8e78-7fd3e8f09730 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:57.561389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e980be2-f9da-4332-85bd-2391c50baf12 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:57.566101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a755a41-eb42-4147-a955-fe37b4345bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:57.567127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a755a41-eb42-4147-a955-fe37b4345bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:57.567415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a755a41-eb42-4147-a955-fe37b4345bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:57.567862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a755a41-eb42-4147-a955-fe37b4345bfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:57.568555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a755a41-eb42-4147-a955-fe37b4345bfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:57.570499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a755a41-eb42-4147-a955-fe37b4345bfb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:58.132639 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 787/1576] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:45:57 2022] POST /identity/v3/projects => generated 377 bytes in 646 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:58.137624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 790/1577] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:45:57 2022] POST /identity/v3/projects => generated 393 bytes in 648 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:58.138074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980be2-f9da-4332-85bd-2391c50baf12 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:58.138204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a755a41-eb42-4147-a955-fe37b4345bfb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:58.209868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e980be2-f9da-4332-85bd-2391c50baf12 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:58.211087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a755a41-eb42-4147-a955-fe37b4345bfb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:58.215678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b35ee-b6c4-40bf-a4cf-89729af59bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:58.216350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b35ee-b6c4-40bf-a4cf-89729af59bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:58.216502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be1bbe-68cb-48e0-8409-2ebcdcd51ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:58.216621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b35ee-b6c4-40bf-a4cf-89729af59bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:58.216903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b35ee-b6c4-40bf-a4cf-89729af59bc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:58.217189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be1bbe-68cb-48e0-8409-2ebcdcd51ace admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:58.217475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be1bbe-68cb-48e0-8409-2ebcdcd51ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:58.217593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b35ee-b6c4-40bf-a4cf-89729af59bc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:58.217787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be1bbe-68cb-48e0-8409-2ebcdcd51ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:58.218518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be1bbe-68cb-48e0-8409-2ebcdcd51ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:58.219701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b35ee-b6c4-40bf-a4cf-89729af59bc8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:58.220110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be1bbe-68cb-48e0-8409-2ebcdcd51ace admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:58.230526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 791/1578] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:58.231343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be1bbe-68cb-48e0-8409-2ebcdcd51ace admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:58.241464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be1bbe-68cb-48e0-8409-2ebcdcd51ace admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:58.246166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e072e-747e-401e-86c3-ddcb9af16523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:58.246808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e072e-747e-401e-86c3-ddcb9af16523 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:58.247099 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e072e-747e-401e-86c3-ddcb9af16523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:58.247376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e072e-747e-401e-86c3-ddcb9af16523 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:58.248063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e072e-747e-401e-86c3-ddcb9af16523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:58.250076 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e072e-747e-401e-86c3-ddcb9af16523 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:58.560876 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 788/1579] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:45:58 2022] POST /identity/v3/projects => generated 385 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:58.561819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b35ee-b6c4-40bf-a4cf-89729af59bc8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:58.619638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 792/1580] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:45:58 2022] POST /identity/v3/users => generated 302 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:58.620821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e072e-747e-401e-86c3-ddcb9af16523 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:58.630110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b35ee-b6c4-40bf-a4cf-89729af59bc8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:58.632666 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e072e-747e-401e-86c3-ddcb9af16523 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:58.635627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08e81b-b97c-4ac5-9fc4-68177e283bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:58.636309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08e81b-b97c-4ac5-9fc4-68177e283bff admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:58.636597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08e81b-b97c-4ac5-9fc4-68177e283bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:58.636878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08e81b-b97c-4ac5-9fc4-68177e283bff admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:58.637574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08e81b-b97c-4ac5-9fc4-68177e283bff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:58.639248 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4d21f-65e1-464b-99e6-de8249c84093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:58.639544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08e81b-b97c-4ac5-9fc4-68177e283bff admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:58.640146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4d21f-65e1-464b-99e6-de8249c84093 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:58.640525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4d21f-65e1-464b-99e6-de8249c84093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:58.640944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4d21f-65e1-464b-99e6-de8249c84093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:58.641987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4d21f-65e1-464b-99e6-de8249c84093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:58.643707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4d21f-65e1-464b-99e6-de8249c84093 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:58.648258 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:58.656443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 793/1581] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:58.657875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf81213-b54b-488a-b7e6-8aa8dbcd150f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:58.658171 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf81213-b54b-488a-b7e6-8aa8dbcd150f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:58.658453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf81213-b54b-488a-b7e6-8aa8dbcd150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:58.693124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fbf81213-b54b-488a-b7e6-8aa8dbcd150f None None] MFA Rules not processed for user `57231ab43d4941a1b12a5171d1fff843`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:58.694538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fbf81213-b54b-488a-b7e6-8aa8dbcd150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:58.760291 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 794/1582] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:58.765320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf81213-b54b-488a-b7e6-8aa8dbcd150f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:58.773378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf81213-b54b-488a-b7e6-8aa8dbcd150f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:58.777899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d10b4e-5abb-4381-90be-b91f31234d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:58.778672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d10b4e-5abb-4381-90be-b91f31234d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:58.778969 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d10b4e-5abb-4381-90be-b91f31234d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:58.779288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d10b4e-5abb-4381-90be-b91f31234d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:58.780097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d10b4e-5abb-4381-90be-b91f31234d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:58.782091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d10b4e-5abb-4381-90be-b91f31234d45 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:58.862649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:59.001917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 789/1583] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:45:58 2022] POST /identity/v3/users => generated 295 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:59.002900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08e81b-b97c-4ac5-9fc4-68177e283bff admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.012509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08e81b-b97c-4ac5-9fc4-68177e283bff admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.017176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b948c-d2cf-43ae-9ff1-d2994c624cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.017871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b948c-d2cf-43ae-9ff1-d2994c624cac admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.018157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b948c-d2cf-43ae-9ff1-d2994c624cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.018435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b948c-d2cf-43ae-9ff1-d2994c624cac admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.019121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b948c-d2cf-43ae-9ff1-d2994c624cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.021042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b948c-d2cf-43ae-9ff1-d2994c624cac admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.080575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 795/1584] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:45:58 2022] POST /identity/v3/users => generated 289 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:59.085833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d10b4e-5abb-4381-90be-b91f31234d45 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.091873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d10b4e-5abb-4381-90be-b91f31234d45 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.096510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f7d1b-9108-4fce-8271-beb3d43469c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.097525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f7d1b-9108-4fce-8271-beb3d43469c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.097835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f7d1b-9108-4fce-8271-beb3d43469c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.098115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f7d1b-9108-4fce-8271-beb3d43469c9 admin admin] PATH_INFO: `/v3/projects/cad768b45d17480d8d6bbbcff6032c8d/users/0537911b91184fcdbdcc9e93ec3fe5b9/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.114764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f7d1b-9108-4fce-8271-beb3d43469c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cad768b45d17480d8d6bbbcff6032c8d, user_id=0537911b91184fcdbdcc9e93ec3fe5b9, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.117379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f7d1b-9108-4fce-8271-beb3d43469c9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.298469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 790/1585] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:45:59 2022] POST /identity/v3/users => generated 297 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:59.299437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b948c-d2cf-43ae-9ff1-d2994c624cac admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.310695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b948c-d2cf-43ae-9ff1-d2994c624cac admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.316092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9e231-e182-430b-8f98-3f296eba7877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.316783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e231-e182-430b-8f98-3f296eba7877 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.317075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e231-e182-430b-8f98-3f296eba7877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.317392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9e231-e182-430b-8f98-3f296eba7877 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.318389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9e231-e182-430b-8f98-3f296eba7877 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.320627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9e231-e182-430b-8f98-3f296eba7877 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.375897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 796/1586] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:45:59 2022] PUT /identity/v3/projects/cad768b45d17480d8d6bbbcff6032c8d/users/0537911b91184fcdbdcc9e93ec3fe5b9/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:59.376650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f7d1b-9108-4fce-8271-beb3d43469c9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.442239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f7d1b-9108-4fce-8271-beb3d43469c9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.446908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38da99d-9971-440e-8c82-1af8c69a38e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.447584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38da99d-9971-440e-8c82-1af8c69a38e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.447867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38da99d-9971-440e-8c82-1af8c69a38e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.448143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38da99d-9971-440e-8c82-1af8c69a38e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.448870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38da99d-9971-440e-8c82-1af8c69a38e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.450521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38da99d-9971-440e-8c82-1af8c69a38e4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.460735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 797/1587] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:59.462123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38da99d-9971-440e-8c82-1af8c69a38e4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.471945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38da99d-9971-440e-8c82-1af8c69a38e4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.476789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffddcac-30bd-4a61-88cd-60e3ef3cd5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.478035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffddcac-30bd-4a61-88cd-60e3ef3cd5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.478319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffddcac-30bd-4a61-88cd-60e3ef3cd5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.478596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffddcac-30bd-4a61-88cd-60e3ef3cd5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.479318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffddcac-30bd-4a61-88cd-60e3ef3cd5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.480919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffddcac-30bd-4a61-88cd-60e3ef3cd5a4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.491058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 798/1588] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:59.492624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffddcac-30bd-4a61-88cd-60e3ef3cd5a4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.551449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffddcac-30bd-4a61-88cd-60e3ef3cd5a4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.555360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e5e87-3c69-4c0e-b341-98ba539a3021 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.556028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e5e87-3c69-4c0e-b341-98ba539a3021 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.556311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e5e87-3c69-4c0e-b341-98ba539a3021 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.556587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e5e87-3c69-4c0e-b341-98ba539a3021 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.614136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 791/1589] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:45:59 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:45:59.614136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9e231-e182-430b-8f98-3f296eba7877 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.617087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e5e87-3c69-4c0e-b341-98ba539a3021 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.618655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e5e87-3c69-4c0e-b341-98ba539a3021 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.626824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9e231-e182-430b-8f98-3f296eba7877 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.626824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152766af-5fd0-40eb-a304-a1fe652b31b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.627294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152766af-5fd0-40eb-a304-a1fe652b31b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.627578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152766af-5fd0-40eb-a304-a1fe652b31b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.627858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152766af-5fd0-40eb-a304-a1fe652b31b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.628135 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 799/1590] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:59.628648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152766af-5fd0-40eb-a304-a1fe652b31b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.628954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e5e87-3c69-4c0e-b341-98ba539a3021 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.630783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152766af-5fd0-40eb-a304-a1fe652b31b1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.640886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e5e87-3c69-4c0e-b341-98ba539a3021 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.644268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 792/1591] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:59.646120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d32ea-06c7-46cc-ae44-354301955d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.646892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d32ea-06c7-46cc-ae44-354301955d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.647228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d32ea-06c7-46cc-ae44-354301955d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.647620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d32ea-06c7-46cc-ae44-354301955d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.648134 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152766af-5fd0-40eb-a304-a1fe652b31b1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.648589 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d32ea-06c7-46cc-ae44-354301955d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.651558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d32ea-06c7-46cc-ae44-354301955d43 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.660174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152766af-5fd0-40eb-a304-a1fe652b31b1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.665262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 800/1592] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:59.665262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c4f42-dbb0-4dfa-83aa-7912450c3afe None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.665262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c4f42-dbb0-4dfa-83aa-7912450c3afe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.665262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c4f42-dbb0-4dfa-83aa-7912450c3afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.669035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c83b-aaec-4b06-a7e5-0d2798c97d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.669747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c83b-aaec-4b06-a7e5-0d2798c97d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.670036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c83b-aaec-4b06-a7e5-0d2798c97d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.670312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873c83b-aaec-4b06-a7e5-0d2798c97d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.671039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873c83b-aaec-4b06-a7e5-0d2798c97d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.672651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a873c83b-aaec-4b06-a7e5-0d2798c97d12 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.682595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f27c4f42-dbb0-4dfa-83aa-7912450c3afe None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:59.684054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f27c4f42-dbb0-4dfa-83aa-7912450c3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:59.685210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 793/1593] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:59.695556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c83b-aaec-4b06-a7e5-0d2798c97d12 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.696208 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 801/1594] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:59.696208 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c4f42-dbb0-4dfa-83aa-7912450c3afe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.704529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873c83b-aaec-4b06-a7e5-0d2798c97d12 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.709122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c4f42-dbb0-4dfa-83aa-7912450c3afe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.712971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b6b0-8bf5-466d-bf1b-6a0b51dd65b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.714176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b6b0-8bf5-466d-bf1b-6a0b51dd65b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.714471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b6b0-8bf5-466d-bf1b-6a0b51dd65b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.714756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1b6b0-8bf5-466d-bf1b-6a0b51dd65b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.715455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db838df4-1992-4aaa-8b00-5b38c4b8c764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.715587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1b6b0-8bf5-466d-bf1b-6a0b51dd65b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.716575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db838df4-1992-4aaa-8b00-5b38c4b8c764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.716986 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db838df4-1992-4aaa-8b00-5b38c4b8c764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.717367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db838df4-1992-4aaa-8b00-5b38c4b8c764 admin admin] PATH_INFO: `/v3/projects/de42350ccb42418bbfee8541e161ba32/users/d3202b452d1042c2ba44d632437d5d13/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.717588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec1b6b0-8bf5-466d-bf1b-6a0b51dd65b2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.735324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 794/1595] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:59.736429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b6b0-8bf5-466d-bf1b-6a0b51dd65b2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.741623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db838df4-1992-4aaa-8b00-5b38c4b8c764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de42350ccb42418bbfee8541e161ba32, user_id=d3202b452d1042c2ba44d632437d5d13, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.746126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db838df4-1992-4aaa-8b00-5b38c4b8c764 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.753538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1b6b0-8bf5-466d-bf1b-6a0b51dd65b2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.759346 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42502b-9ea2-46c1-a4bf-b1ec3e6a7b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.760048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42502b-9ea2-46c1-a4bf-b1ec3e6a7b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.760336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42502b-9ea2-46c1-a4bf-b1ec3e6a7b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.760645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b42502b-9ea2-46c1-a4bf-b1ec3e6a7b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.761427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42502b-9ea2-46c1-a4bf-b1ec3e6a7b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.763173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b42502b-9ea2-46c1-a4bf-b1ec3e6a7b99 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.774989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 795/1596] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:59.775894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42502b-9ea2-46c1-a4bf-b1ec3e6a7b99 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.786719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b42502b-9ea2-46c1-a4bf-b1ec3e6a7b99 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.791655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85785e-e1c1-4819-a30f-4cb0561a3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.792357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85785e-e1c1-4819-a30f-4cb0561a3ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.792642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85785e-e1c1-4819-a30f-4cb0561a3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.792923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85785e-e1c1-4819-a30f-4cb0561a3ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.793723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85785e-e1c1-4819-a30f-4cb0561a3ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.795380 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85785e-e1c1-4819-a30f-4cb0561a3ea8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.806750 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 796/1597] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:59.807634 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85785e-e1c1-4819-a30f-4cb0561a3ea8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.819718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85785e-e1c1-4819-a30f-4cb0561a3ea8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.825576 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546cc8a-d84e-4226-b0d6-45409646a7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.826306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546cc8a-d84e-4226-b0d6-45409646a7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.826630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546cc8a-d84e-4226-b0d6-45409646a7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.826916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546cc8a-d84e-4226-b0d6-45409646a7b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.827650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546cc8a-d84e-4226-b0d6-45409646a7b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.829263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546cc8a-d84e-4226-b0d6-45409646a7b3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.841055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 797/1598] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:59.841990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546cc8a-d84e-4226-b0d6-45409646a7b3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.852295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546cc8a-d84e-4226-b0d6-45409646a7b3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.857103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e227ee5-0ad9-4363-8068-d14f791998d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.857804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e227ee5-0ad9-4363-8068-d14f791998d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.858094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e227ee5-0ad9-4363-8068-d14f791998d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.858377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e227ee5-0ad9-4363-8068-d14f791998d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.859102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e227ee5-0ad9-4363-8068-d14f791998d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.860694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e227ee5-0ad9-4363-8068-d14f791998d7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.870855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 798/1599] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:45:59.871800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e227ee5-0ad9-4363-8068-d14f791998d7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.929412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e227ee5-0ad9-4363-8068-d14f791998d7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:59.933833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca223984-f02b-4579-aec3-b802818be7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:59.934803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223984-f02b-4579-aec3-b802818be7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:59.935344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223984-f02b-4579-aec3-b802818be7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:59.935630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca223984-f02b-4579-aec3-b802818be7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:59.937726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 802/1600] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:45:59 2022] PUT /identity/v3/projects/de42350ccb42418bbfee8541e161ba32/users/d3202b452d1042c2ba44d632437d5d13/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:45:59.938523 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db838df4-1992-4aaa-8b00-5b38c4b8c764 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.950700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca223984-f02b-4579-aec3-b802818be7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:59.952214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca223984-f02b-4579-aec3-b802818be7a1 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:59.963152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 799/1601] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:59.963819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca223984-f02b-4579-aec3-b802818be7a1 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:59.974625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca223984-f02b-4579-aec3-b802818be7a1 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:00.018043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db838df4-1992-4aaa-8b00-5b38c4b8c764 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:00.022776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f587-152a-4e08-83c6-ed2f2559f34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:00.023690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f587-152a-4e08-83c6-ed2f2559f34b admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.024004 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f587-152a-4e08-83c6-ed2f2559f34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.024284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6f587-152a-4e08-83c6-ed2f2559f34b admin admin] PATH_INFO: `/v3/projects/fc5815d8eef24db5b64a02ff8a4507e3/users/ed8b0bf54a5742989934a8c099c863d8/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.029218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:00.039351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6f587-152a-4e08-83c6-ed2f2559f34b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5815d8eef24db5b64a02ff8a4507e3, user_id=ed8b0bf54a5742989934a8c099c863d8, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:00.042097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d6f587-152a-4e08-83c6-ed2f2559f34b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:00.045706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd1cad-4839-4d25-9a44-bcc57feda2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:00.046371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd1cad-4839-4d25-9a44-bcc57feda2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.046709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd1cad-4839-4d25-9a44-bcc57feda2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.046994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd1cad-4839-4d25-9a44-bcc57feda2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.047720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd1cad-4839-4d25-9a44-bcc57feda2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:00.049315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd1cad-4839-4d25-9a44-bcc57feda2a2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:00.060408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 800/1602] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:00.073341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd1cad-4839-4d25-9a44-bcc57feda2a2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:00.073341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd1cad-4839-4d25-9a44-bcc57feda2a2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:00.078339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5cd7-8a4b-4530-affe-cd4b7e514912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:00.079216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5cd7-8a4b-4530-affe-cd4b7e514912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.079502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5cd7-8a4b-4530-affe-cd4b7e514912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.079781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba5cd7-8a4b-4530-affe-cd4b7e514912 admin admin] PATH_INFO: `/v3/projects/a90e7edce8984d49b7bdebed2947b436/users/1e83db01f0b24204a61b037b3c1f044c/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.096835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba5cd7-8a4b-4530-affe-cd4b7e514912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a90e7edce8984d49b7bdebed2947b436, user_id=1e83db01f0b24204a61b037b3c1f044c, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:00.099545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba5cd7-8a4b-4530-affe-cd4b7e514912 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:00.125380 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:00.190889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 803/1603] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:45:59 2022] PUT /identity/v3/projects/fc5815d8eef24db5b64a02ff8a4507e3/users/ed8b0bf54a5742989934a8c099c863d8/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:00.192852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f587-152a-4e08-83c6-ed2f2559f34b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:00.261130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6f587-152a-4e08-83c6-ed2f2559f34b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:00.266056 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d248a4-aa2d-45f3-904a-31c4162bbd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:00.267698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d248a4-aa2d-45f3-904a-31c4162bbd60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.268100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d248a4-aa2d-45f3-904a-31c4162bbd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.268502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d248a4-aa2d-45f3-904a-31c4162bbd60 admin admin] PATH_INFO: `/v3/projects/3cd0ea68fb8a43e886d0c9722d766ba6/users/4d380efbe8c44fb3bbc58c9913cb25e6/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.275724 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 801/1604] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:00 2022] PUT /identity/v3/projects/a90e7edce8984d49b7bdebed2947b436/users/1e83db01f0b24204a61b037b3c1f044c/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:00.276239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5cd7-8a4b-4530-affe-cd4b7e514912 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:00.288543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d248a4-aa2d-45f3-904a-31c4162bbd60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cd0ea68fb8a43e886d0c9722d766ba6, user_id=4d380efbe8c44fb3bbc58c9913cb25e6, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:00.291417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d248a4-aa2d-45f3-904a-31c4162bbd60 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:00.338895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba5cd7-8a4b-4530-affe-cd4b7e514912 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:00.343584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dada8b-126b-4e3e-9732-7be60f649bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:00.344464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dada8b-126b-4e3e-9732-7be60f649bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.344746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dada8b-126b-4e3e-9732-7be60f649bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.345025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dada8b-126b-4e3e-9732-7be60f649bb2 admin admin] PATH_INFO: `/v3/projects/9930a0f4448d4ef0a6030da17a36257a/users/cf98a4d33cab49b08640f437dbfb2dc8/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.359865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dada8b-126b-4e3e-9732-7be60f649bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9930a0f4448d4ef0a6030da17a36257a, user_id=cf98a4d33cab49b08640f437dbfb2dc8, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:00.362578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dada8b-126b-4e3e-9732-7be60f649bb2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:00.529538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 804/1605] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:00 2022] PUT /identity/v3/projects/3cd0ea68fb8a43e886d0c9722d766ba6/users/4d380efbe8c44fb3bbc58c9913cb25e6/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:00.531199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbcf3a-b223-4b14-8dbf-2f73b47adace None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.531498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbcf3a-b223-4b14-8dbf-2f73b47adace None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.531784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbcf3a-b223-4b14-8dbf-2f73b47adace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.563472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 802/1606] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:00 2022] PUT /identity/v3/projects/9930a0f4448d4ef0a6030da17a36257a/users/cf98a4d33cab49b08640f437dbfb2dc8/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:00.565315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dada8b-126b-4e3e-9732-7be60f649bb2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:00.599546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-debbcf3a-b223-4b14-8dbf-2f73b47adace None None] MFA Rules not processed for user `d3202b452d1042c2ba44d632437d5d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:00.607349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-debbcf3a-b223-4b14-8dbf-2f73b47adace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:00.676371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:00.685895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dada8b-126b-4e3e-9732-7be60f649bb2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:00.691235 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56ffe8-8334-4087-aa71-81aa0786a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:00.692295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56ffe8-8334-4087-aa71-81aa0786a5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.692469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56ffe8-8334-4087-aa71-81aa0786a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.692722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56ffe8-8334-4087-aa71-81aa0786a5e8 admin admin] PATH_INFO: `/v3/projects/fae36bb3997f4f14b8f1a0bcaf0fca1a/users/d1a4623e202d4d359037fb958a4e1e7c/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.705863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 805/1607] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:00.707261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b76ed-85b7-4a50-a6ab-f55e3a07cd68 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.707708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b76ed-85b7-4a50-a6ab-f55e3a07cd68 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.708231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b76ed-85b7-4a50-a6ab-f55e3a07cd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.709764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56ffe8-8334-4087-aa71-81aa0786a5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fae36bb3997f4f14b8f1a0bcaf0fca1a, user_id=d1a4623e202d4d359037fb958a4e1e7c, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:00.713192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c56ffe8-8334-4087-aa71-81aa0786a5e8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:00.731730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-402b76ed-85b7-4a50-a6ab-f55e3a07cd68 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:00.733341 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-402b76ed-85b7-4a50-a6ab-f55e3a07cd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:00.742312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 806/1608] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:00.759120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d7065-8de6-41a8-91c1-142b632a88d0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.759120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d7065-8de6-41a8-91c1-142b632a88d0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.759120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d7065-8de6-41a8-91c1-142b632a88d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.763974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-265d7065-8de6-41a8-91c1-142b632a88d0 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:00.765194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-265d7065-8de6-41a8-91c1-142b632a88d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:00.773044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 807/1609] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:00.774885 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f093b-04f6-4ebd-93d6-31a96e183a55 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.775175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f093b-04f6-4ebd-93d6-31a96e183a55 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.775455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f093b-04f6-4ebd-93d6-31a96e183a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.795120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-302f093b-04f6-4ebd-93d6-31a96e183a55 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:00.801872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-302f093b-04f6-4ebd-93d6-31a96e183a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:00.804204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 808/1610] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:00.805864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471cb94-3888-4399-a2c2-e4034a4ed2fa None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.806021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471cb94-3888-4399-a2c2-e4034a4ed2fa None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.806191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471cb94-3888-4399-a2c2-e4034a4ed2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.829405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7471cb94-3888-4399-a2c2-e4034a4ed2fa None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:00.831399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7471cb94-3888-4399-a2c2-e4034a4ed2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:00.841552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 809/1611] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:00.842432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471cb94-3888-4399-a2c2-e4034a4ed2fa None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:00.854637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471cb94-3888-4399-a2c2-e4034a4ed2fa None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:00.859596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec5a13-ca1b-4001-8a0d-c377395f2512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:00.860275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5a13-ca1b-4001-8a0d-c377395f2512 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.860569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5a13-ca1b-4001-8a0d-c377395f2512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.860854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec5a13-ca1b-4001-8a0d-c377395f2512 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.861556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec5a13-ca1b-4001-8a0d-c377395f2512 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:00.863525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec5a13-ca1b-4001-8a0d-c377395f2512 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:00.899360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 803/1612] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:00 2022] PUT /identity/v3/projects/fae36bb3997f4f14b8f1a0bcaf0fca1a/users/d1a4623e202d4d359037fb958a4e1e7c/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:00.900446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56ffe8-8334-4087-aa71-81aa0786a5e8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:00.939444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:00.981392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56ffe8-8334-4087-aa71-81aa0786a5e8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:00.987662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f0584-8286-4f57-a313-45cd91ec859e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:00.990447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f0584-8286-4f57-a313-45cd91ec859e service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:00.990447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f0584-8286-4f57-a313-45cd91ec859e service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:00.990447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f0584-8286-4f57-a313-45cd91ec859e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:00.998343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 810/1613] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:00 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:01.003195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec5a13-ca1b-4001-8a0d-c377395f2512 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:01.099023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f0584-8286-4f57-a313-45cd91ec859e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:01.099799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec5a13-ca1b-4001-8a0d-c377395f2512 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:01.106852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f0584-8286-4f57-a313-45cd91ec859e service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:01.106998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b77c5-439b-4b4a-b1fc-b976e1485266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:01.106998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b77c5-439b-4b4a-b1fc-b976e1485266 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.106998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b77c5-439b-4b4a-b1fc-b976e1485266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.106998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b77c5-439b-4b4a-b1fc-b976e1485266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.120760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 804/1614] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:01.121757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f0584-8286-4f57-a313-45cd91ec859e service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:01.132214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f0584-8286-4f57-a313-45cd91ec859e service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:01.140350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8960c9e-adc0-4e93-93e9-a98d2cb52feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:01.142042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8960c9e-adc0-4e93-93e9-a98d2cb52feb service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.142795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8960c9e-adc0-4e93-93e9-a98d2cb52feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.143359 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8960c9e-adc0-4e93-93e9-a98d2cb52feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.174630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:01.201363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b77c5-439b-4b4a-b1fc-b976e1485266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:01.202714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b77c5-439b-4b4a-b1fc-b976e1485266 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:01.213993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 811/1615] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:01.214707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b77c5-439b-4b4a-b1fc-b976e1485266 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:01.223866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b77c5-439b-4b4a-b1fc-b976e1485266 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:01.228819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b329506-96e4-410e-b779-4cad973bb921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:01.229807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b329506-96e4-410e-b779-4cad973bb921 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.230260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b329506-96e4-410e-b779-4cad973bb921 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.230714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b329506-96e4-410e-b779-4cad973bb921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.241124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b329506-96e4-410e-b779-4cad973bb921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:01.243877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b329506-96e4-410e-b779-4cad973bb921 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:01.256515 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 812/1616] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:01.267797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8596d9-67e7-49cd-9d0b-fbe213f7bcab None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.267797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8596d9-67e7-49cd-9d0b-fbe213f7bcab None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.267797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8596d9-67e7-49cd-9d0b-fbe213f7bcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.268441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8960c9e-adc0-4e93-93e9-a98d2cb52feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:01.268441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8960c9e-adc0-4e93-93e9-a98d2cb52feb service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:01.282280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 805/1617] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:01.283649 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8960c9e-adc0-4e93-93e9-a98d2cb52feb service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:01.294252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8f8596d9-67e7-49cd-9d0b-fbe213f7bcab None None] MFA Rules not processed for user `d1a4623e202d4d359037fb958a4e1e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:01.295851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8f8596d9-67e7-49cd-9d0b-fbe213f7bcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:01.298313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8960c9e-adc0-4e93-93e9-a98d2cb52feb service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:01.304697 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4010f5-b91e-4bf2-acd7-4dbb3900cf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:01.305642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4010f5-b91e-4bf2-acd7-4dbb3900cf27 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.306032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4010f5-b91e-4bf2-acd7-4dbb3900cf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.306422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4010f5-b91e-4bf2-acd7-4dbb3900cf27 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.307253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4010f5-b91e-4bf2-acd7-4dbb3900cf27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:01.310084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4010f5-b91e-4bf2-acd7-4dbb3900cf27 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:01.393983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 813/1618] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:01.423356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1207f2-4e34-417b-ad64-ac836acd006b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.456530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1207f2-4e34-417b-ad64-ac836acd006b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.456530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1207f2-4e34-417b-ad64-ac836acd006b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.456530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 814/1619] 10.222.0.41 () {54 vars in 961 bytes} [Thu May 26 12:46:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:46:01.456530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27b728-6d98-4427-937c-a7e3480b0bf0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.456530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27b728-6d98-4427-937c-a7e3480b0bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.456530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27b728-6d98-4427-937c-a7e3480b0bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.470036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1a27b728-6d98-4427-937c-a7e3480b0bf0 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:01.471259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1a27b728-6d98-4427-937c-a7e3480b0bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:01.565722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 806/1620] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:01 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:01.566347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 815/1621] 10.222.0.41 () {58 vars in 1058 bytes} [Thu May 26 12:46:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:01.571946 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4010f5-b91e-4bf2-acd7-4dbb3900cf27 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:01.578551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27b728-6d98-4427-937c-a7e3480b0bf0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:01.588538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4010f5-b91e-4bf2-acd7-4dbb3900cf27 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:01.597600 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6fa20-b422-4c10-99fa-de20ffb9944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:01.599198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6fa20-b422-4c10-99fa-de20ffb9944e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.599672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6fa20-b422-4c10-99fa-de20ffb9944e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.600210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d6fa20-b422-4c10-99fa-de20ffb9944e admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.601390 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6fa20-b422-4c10-99fa-de20ffb9944e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:01.603434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d6fa20-b422-4c10-99fa-de20ffb9944e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:01.605648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27b728-6d98-4427-937c-a7e3480b0bf0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:01.623940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e495c-c66f-431b-8748-2df23f13be87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:01.625483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 807/1622] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:01.626267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e495c-c66f-431b-8748-2df23f13be87 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.626624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6fa20-b422-4c10-99fa-de20ffb9944e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:01.627888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e495c-c66f-431b-8748-2df23f13be87 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.631753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e495c-c66f-431b-8748-2df23f13be87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.644807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d6fa20-b422-4c10-99fa-de20ffb9944e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:01.652336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e495c-c66f-431b-8748-2df23f13be87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:01.656363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56e495c-c66f-431b-8748-2df23f13be87 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:01.662567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8558ea90-d267-4fc8-9c95-8f6df5bd495d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:01.665097 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ea90-d267-4fc8-9c95-8f6df5bd495d admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.665601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ea90-d267-4fc8-9c95-8f6df5bd495d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.666094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8558ea90-d267-4fc8-9c95-8f6df5bd495d admin admin] PATH_INFO: `/v3/projects/610e6e128be849cabcd2ac1708fa827f/users/6fd25abea6a943a48cd2a03939ffe3d7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.694807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 816/1623] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:01.698307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558ea90-d267-4fc8-9c95-8f6df5bd495d admin admin] RBAC: Authorizing `identity:create_grant(project_id=610e6e128be849cabcd2ac1708fa827f, user_id=6fd25abea6a943a48cd2a03939ffe3d7, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:01.704246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8558ea90-d267-4fc8-9c95-8f6df5bd495d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:01.930406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 808/1624] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:01 2022] PUT /identity/v3/projects/610e6e128be849cabcd2ac1708fa827f/users/6fd25abea6a943a48cd2a03939ffe3d7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:01.931500 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e495c-c66f-431b-8748-2df23f13be87 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:01.945633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e495c-c66f-431b-8748-2df23f13be87 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:01.978119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8153e-2808-4f0e-baff-afb57b9fa958 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.978419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8153e-2808-4f0e-baff-afb57b9fa958 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.978807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8153e-2808-4f0e-baff-afb57b9fa958 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:01.980364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 809/1625] 10.222.0.41 () {54 vars in 912 bytes} [Thu May 26 12:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:46:01.990461 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9334629-9d6f-4495-a081-6e82a9eabdc9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:01.990772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9334629-9d6f-4495-a081-6e82a9eabdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:01.991116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9334629-9d6f-4495-a081-6e82a9eabdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:02.036355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f9334629-9d6f-4495-a081-6e82a9eabdc9 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:02.036678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f9334629-9d6f-4495-a081-6e82a9eabdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:02.037408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b58fb3-493c-4dce-867f-9a9ac6ef02aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:02.038212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b58fb3-493c-4dce-867f-9a9ac6ef02aa admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:02.038509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b58fb3-493c-4dce-867f-9a9ac6ef02aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:02.038847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b58fb3-493c-4dce-867f-9a9ac6ef02aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:02.039642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b58fb3-493c-4dce-867f-9a9ac6ef02aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:02.042663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b58fb3-493c-4dce-867f-9a9ac6ef02aa admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:02.058725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 817/1626] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:46:02.062677 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b58fb3-493c-4dce-867f-9a9ac6ef02aa admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:02.065008 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:02.081327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b58fb3-493c-4dce-867f-9a9ac6ef02aa admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:02.091041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872de18-e297-4970-9681-9aa431d31b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:02.092802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872de18-e297-4970-9681-9aa431d31b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:02.093348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872de18-e297-4970-9681-9aa431d31b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:02.093905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872de18-e297-4970-9681-9aa431d31b5b admin admin] PATH_INFO: `/v3/projects/610e6e128be849cabcd2ac1708fa827f/users/6fd25abea6a943a48cd2a03939ffe3d7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:02.096851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872de18-e297-4970-9681-9aa431d31b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=610e6e128be849cabcd2ac1708fa827f, user_id=6fd25abea6a943a48cd2a03939ffe3d7, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:02.101264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872de18-e297-4970-9681-9aa431d31b5b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:02.131571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 818/1627] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:02 2022] PUT /identity/v3/projects/610e6e128be849cabcd2ac1708fa827f/users/6fd25abea6a943a48cd2a03939ffe3d7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:02.134390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f20306-6803-4a07-88e1-6d70728b4908 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:02.134924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f20306-6803-4a07-88e1-6d70728b4908 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:02.135450 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f20306-6803-4a07-88e1-6d70728b4908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:02.190843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 810/1628] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:46:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:02.197700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-42f20306-6803-4a07-88e1-6d70728b4908 None None] MFA Rules not processed for user `6fd25abea6a943a48cd2a03939ffe3d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:02.199853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-42f20306-6803-4a07-88e1-6d70728b4908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:02.204549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9334629-9d6f-4495-a081-6e82a9eabdc9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:02.268119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9334629-9d6f-4495-a081-6e82a9eabdc9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:02.300466 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 819/1629] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:02.312953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f20306-6803-4a07-88e1-6d70728b4908 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:02.331400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0910f-b5f6-4c22-ad40-6b09b5a8264e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:02.332262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0910f-b5f6-4c22-ad40-6b09b5a8264e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:02.332686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0910f-b5f6-4c22-ad40-6b09b5a8264e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:02.333422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0910f-b5f6-4c22-ad40-6b09b5a8264e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:02.398172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f20306-6803-4a07-88e1-6d70728b4908 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:02.402465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d1867-32bd-444e-9e98-2f5f3c2991de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:02.403140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1867-32bd-444e-9e98-2f5f3c2991de service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:02.403420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1867-32bd-444e-9e98-2f5f3c2991de service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:02.403760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d1867-32bd-444e-9e98-2f5f3c2991de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:02.432386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0910f-b5f6-4c22-ad40-6b09b5a8264e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:02.434302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0910f-b5f6-4c22-ad40-6b09b5a8264e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:02.453057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 811/1630] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:02.513084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d1867-32bd-444e-9e98-2f5f3c2991de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:02.515655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d1867-32bd-444e-9e98-2f5f3c2991de service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:02.541309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 820/1631] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:03.104996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:04.171628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:04.651980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcbebe-3306-4357-b260-05ed03ef8a3a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:04.651980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcbebe-3306-4357-b260-05ed03ef8a3a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:04.651980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcbebe-3306-4357-b260-05ed03ef8a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:04.762322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5bdcbebe-3306-4357-b260-05ed03ef8a3a None None] MFA Rules not processed for user `ed8b0bf54a5742989934a8c099c863d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:04.764255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5bdcbebe-3306-4357-b260-05ed03ef8a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:04.826142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c9a6-274a-4cda-b508-e4f30d505380 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:04.826142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c9a6-274a-4cda-b508-e4f30d505380 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:04.826142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e60c9a6-274a-4cda-b508-e4f30d505380 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:04.826142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 821/1632] 10.222.0.41 () {54 vars in 961 bytes} [Thu May 26 12:46:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:46:04.849236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86334936-4da9-4560-bc5c-d23cbb7dae27 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:04.849802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86334936-4da9-4560-bc5c-d23cbb7dae27 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:04.853386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86334936-4da9-4560-bc5c-d23cbb7dae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:04.873447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:04.910280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-86334936-4da9-4560-bc5c-d23cbb7dae27 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:04.919145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-86334936-4da9-4560-bc5c-d23cbb7dae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:04.947983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 822/1633] 10.222.0.41 () {58 vars in 1058 bytes} [Thu May 26 12:46:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:04.953764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078a3e-7c9c-46bf-ae55-17a0218f2de7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:04.953764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078a3e-7c9c-46bf-ae55-17a0218f2de7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:04.953764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a078a3e-7c9c-46bf-ae55-17a0218f2de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:04.954054 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 812/1634] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:04.964455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcbebe-3306-4357-b260-05ed03ef8a3a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:05.034814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1a078a3e-7c9c-46bf-ae55-17a0218f2de7 None None] MFA Rules not processed for user `4d380efbe8c44fb3bbc58c9913cb25e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:05.036866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1a078a3e-7c9c-46bf-ae55-17a0218f2de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:05.112938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcbebe-3306-4357-b260-05ed03ef8a3a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:05.123314 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347d0d6-cada-4f6d-bd75-1f643be09feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:05.124589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347d0d6-cada-4f6d-bd75-1f643be09feb admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:05.124756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347d0d6-cada-4f6d-bd75-1f643be09feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:05.125026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347d0d6-cada-4f6d-bd75-1f643be09feb admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:05.125772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347d0d6-cada-4f6d-bd75-1f643be09feb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:05.128246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347d0d6-cada-4f6d-bd75-1f643be09feb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:05.222940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 823/1635] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:05.222940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295043de-83cc-4bf0-8282-2208c05819c0 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:05.222940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295043de-83cc-4bf0-8282-2208c05819c0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:05.222940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295043de-83cc-4bf0-8282-2208c05819c0 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:05.222940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 824/1636] 10.222.0.41 () {54 vars in 912 bytes} [Thu May 26 12:46:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:46:05.246635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477b7e-af39-4904-a253-5d64fde16187 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:05.246635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477b7e-af39-4904-a253-5d64fde16187 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:05.246635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81477b7e-af39-4904-a253-5d64fde16187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:05.272996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-81477b7e-af39-4904-a253-5d64fde16187 None None] MFA Rules not processed for user `4d380efbe8c44fb3bbc58c9913cb25e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:05.274958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-81477b7e-af39-4904-a253-5d64fde16187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:05.285013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 813/1637] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:04 2022] POST /identity/v3/projects => generated 405 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:05.287396 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f5e72-8929-42e1-b6c1-7d7d524f3c93 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:05.288062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f5e72-8929-42e1-b6c1-7d7d524f3c93 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:05.288590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f5e72-8929-42e1-b6c1-7d7d524f3c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:05.297218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 825/1638] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:05.304235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81477b7e-af39-4904-a253-5d64fde16187 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:05.326876 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-943f5e72-8929-42e1-b6c1-7d7d524f3c93 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:05.328577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-943f5e72-8929-42e1-b6c1-7d7d524f3c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:05.333756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81477b7e-af39-4904-a253-5d64fde16187 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:05.507388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaf773-49b6-4da5-a63d-4a7c9b930281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:05.536119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaf773-49b6-4da5-a63d-4a7c9b930281 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:05.536119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaf773-49b6-4da5-a63d-4a7c9b930281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:05.536119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beaf773-49b6-4da5-a63d-4a7c9b930281 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:05.536119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beaf773-49b6-4da5-a63d-4a7c9b930281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:05.536119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beaf773-49b6-4da5-a63d-4a7c9b930281 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:05.537154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 814/1639] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:46:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:05.537154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f5e72-8929-42e1-b6c1-7d7d524f3c93 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:05.548665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f5e72-8929-42e1-b6c1-7d7d524f3c93 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:05.555685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b291a-948e-4320-a597-bb24948785ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:05.556365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b291a-948e-4320-a597-bb24948785ca service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:05.556697 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b291a-948e-4320-a597-bb24948785ca service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:05.557147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b291a-948e-4320-a597-bb24948785ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:05.649943 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b291a-948e-4320-a597-bb24948785ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:05.651666 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b291a-948e-4320-a597-bb24948785ca service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:05.669009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 815/1640] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:05.674843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b291a-948e-4320-a597-bb24948785ca service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:05.840769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b291a-948e-4320-a597-bb24948785ca service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:05.849075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31b21d-30e8-4693-a441-193eb7398654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:05.849075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31b21d-30e8-4693-a441-193eb7398654 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:05.849443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31b21d-30e8-4693-a441-193eb7398654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:05.849540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31b21d-30e8-4693-a441-193eb7398654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:05.868895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31b21d-30e8-4693-a441-193eb7398654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:05.870699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31b21d-30e8-4693-a441-193eb7398654 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:05.890869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 816/1641] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:06.207643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2fad-1c07-4802-bac0-4f7281baf198 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:06.207938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2fad-1c07-4802-bac0-4f7281baf198 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:06.208216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d2fad-1c07-4802-bac0-4f7281baf198 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:06.212006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 817/1642] 10.222.0.41 () {54 vars in 912 bytes} [Thu May 26 12:46:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:46:06.220668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005d5c-ced0-48d2-80de-0ae024c50969 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:06.220961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005d5c-ced0-48d2-80de-0ae024c50969 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:06.221244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005d5c-ced0-48d2-80de-0ae024c50969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:06.248887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 826/1643] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:05 2022] POST /identity/v3/users => generated 309 bytes in 951 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:06.250432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaf773-49b6-4da5-a63d-4a7c9b930281 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:06.263582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beaf773-49b6-4da5-a63d-4a7c9b930281 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:06.289488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac58e-2b65-440d-bea0-c82e4bf219d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:06.293429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac58e-2b65-440d-bea0-c82e4bf219d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:06.294379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac58e-2b65-440d-bea0-c82e4bf219d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:06.295057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ac58e-2b65-440d-bea0-c82e4bf219d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:06.297777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ac58e-2b65-440d-bea0-c82e4bf219d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:06.303938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ac58e-2b65-440d-bea0-c82e4bf219d0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:06.319120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2e005d5c-ced0-48d2-80de-0ae024c50969 None None] MFA Rules not processed for user `d7a0dbcea7ef4cdd9134f4c5a9cf5fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:06.322254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2e005d5c-ced0-48d2-80de-0ae024c50969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:06.339383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 827/1644] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:06.341642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac58e-2b65-440d-bea0-c82e4bf219d0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:06.358861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ac58e-2b65-440d-bea0-c82e4bf219d0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:06.376335 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0d2fb-be9b-4b8b-9783-e3ab8508ca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:06.378275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d2fb-be9b-4b8b-9783-e3ab8508ca96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:06.378600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d2fb-be9b-4b8b-9783-e3ab8508ca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:06.384107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d2fb-be9b-4b8b-9783-e3ab8508ca96 admin admin] PATH_INFO: `/v3/projects/124fd15cdc844acf8bc9f72318470223/users/3fa1d79aebb94d259217ee6cf8073190/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:06.460939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0d2fb-be9b-4b8b-9783-e3ab8508ca96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124fd15cdc844acf8bc9f72318470223, user_id=3fa1d79aebb94d259217ee6cf8073190, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:06.467620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0d2fb-be9b-4b8b-9783-e3ab8508ca96 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:06.512459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 818/1645] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:46:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:06.579613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 828/1646] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:06 2022] PUT /identity/v3/projects/124fd15cdc844acf8bc9f72318470223/users/3fa1d79aebb94d259217ee6cf8073190/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:06.587917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e005d5c-ced0-48d2-80de-0ae024c50969 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:06.615259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0d2fb-be9b-4b8b-9783-e3ab8508ca96 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:06.641565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e005d5c-ced0-48d2-80de-0ae024c50969 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:06.765696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa1a9a-102c-4438-8326-5d437ab65a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:06.767400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa1a9a-102c-4438-8326-5d437ab65a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:06.767589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa1a9a-102c-4438-8326-5d437ab65a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:06.767872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42aa1a9a-102c-4438-8326-5d437ab65a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:06.769221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa1a9a-102c-4438-8326-5d437ab65a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:06.773266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42aa1a9a-102c-4438-8326-5d437ab65a32 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:06.795235 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 819/1647] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:06.808990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa1a9a-102c-4438-8326-5d437ab65a32 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:06.860260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42aa1a9a-102c-4438-8326-5d437ab65a32 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:06.868730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0d2fb-be9b-4b8b-9783-e3ab8508ca96 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:06.877190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170cd1ff-0499-4b2d-92be-78a7184f9c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:06.880018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cd1ff-0499-4b2d-92be-78a7184f9c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:06.882118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cd1ff-0499-4b2d-92be-78a7184f9c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:06.882437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170cd1ff-0499-4b2d-92be-78a7184f9c43 admin admin] PATH_INFO: `/v3/projects/124fd15cdc844acf8bc9f72318470223/users/3fa1d79aebb94d259217ee6cf8073190/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:06.883237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713aa01-4d05-43c3-b1e7-aa53a50b0e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:06.888784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cd1ff-0499-4b2d-92be-78a7184f9c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124fd15cdc844acf8bc9f72318470223, user_id=3fa1d79aebb94d259217ee6cf8073190, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:06.891179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713aa01-4d05-43c3-b1e7-aa53a50b0e53 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:06.891533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713aa01-4d05-43c3-b1e7-aa53a50b0e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:06.891924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713aa01-4d05-43c3-b1e7-aa53a50b0e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:06.895668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170cd1ff-0499-4b2d-92be-78a7184f9c43 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:06.918800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713aa01-4d05-43c3-b1e7-aa53a50b0e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:06.926206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713aa01-4d05-43c3-b1e7-aa53a50b0e53 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:06.926818 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 820/1648] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:06 2022] PUT /identity/v3/projects/124fd15cdc844acf8bc9f72318470223/users/3fa1d79aebb94d259217ee6cf8073190/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:06.956807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 829/1649] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:07.143384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:07.570171 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:08.146599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f6617-3494-46a5-a4e2-6165807027ad None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:08.147575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f6617-3494-46a5-a4e2-6165807027ad None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:08.148212 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f6617-3494-46a5-a4e2-6165807027ad None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:08.150683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 821/1650] 10.222.0.41 () {54 vars in 960 bytes} [Thu May 26 12:46:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:46:08.156642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e61c1-274c-4d57-8cca-1ac79ade2d34 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:08.156935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e61c1-274c-4d57-8cca-1ac79ade2d34 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:08.157311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e61c1-274c-4d57-8cca-1ac79ade2d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:08.204633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e27e61c1-274c-4d57-8cca-1ac79ade2d34 None None] MFA Rules not processed for user `0412209ee10a46558a8baf10b59f89a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:08.207400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e27e61c1-274c-4d57-8cca-1ac79ade2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:08.370825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f6617-3494-46a5-a4e2-6165807027ad None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:08.379746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 830/1651] 10.222.0.41 () {58 vars in 1057 bytes} [Thu May 26 12:46:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:08.396430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f6617-3494-46a5-a4e2-6165807027ad None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:08.404796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82e30f-0666-4370-911b-222d5b71b197 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:08.405408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e30f-0666-4370-911b-222d5b71b197 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:08.405730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e30f-0666-4370-911b-222d5b71b197 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:08.406060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82e30f-0666-4370-911b-222d5b71b197 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:08.409825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9f82e30f-0666-4370-911b-222d5b71b197 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:08.435633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82e30f-0666-4370-911b-222d5b71b197 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:08.439786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82e30f-0666-4370-911b-222d5b71b197 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:08.510800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 822/1652] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:08.635371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:11.164769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30f31b-542f-4091-a1b0-c8169e4e85bf None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:11.166571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30f31b-542f-4091-a1b0-c8169e4e85bf None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:11.167487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30f31b-542f-4091-a1b0-c8169e4e85bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:11.297659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cd30f31b-542f-4091-a1b0-c8169e4e85bf None None] MFA Rules not processed for user `3fa1d79aebb94d259217ee6cf8073190`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:11.304228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cd30f31b-542f-4091-a1b0-c8169e4e85bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:11.401392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82e30f-0666-4370-911b-222d5b71b197 service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:11.578778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82e30f-0666-4370-911b-222d5b71b197 service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:11.583399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c33276c-6193-4c1e-ac60-d589e70cce39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:11.584218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33276c-6193-4c1e-ac60-d589e70cce39 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:11.584516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33276c-6193-4c1e-ac60-d589e70cce39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:11.585746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c33276c-6193-4c1e-ac60-d589e70cce39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:11.612213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 831/1653] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:11.724658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33276c-6193-4c1e-ac60-d589e70cce39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:11.730548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c33276c-6193-4c1e-ac60-d589e70cce39 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:11.753096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 823/1654] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:11 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:14.130873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac3a8d-51e9-41fd-a6d3-a11dfbe1d383 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:14.131666 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac3a8d-51e9-41fd-a6d3-a11dfbe1d383 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:14.131666 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac3a8d-51e9-41fd-a6d3-a11dfbe1d383 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:14.133750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 832/1655] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:46:14.170498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da629c-6f26-49ab-9537-cd5df70f2457 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:14.171270 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da629c-6f26-49ab-9537-cd5df70f2457 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:14.171357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da629c-6f26-49ab-9537-cd5df70f2457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:14.235215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b6da629c-6f26-49ab-9537-cd5df70f2457 None None] MFA Rules not processed for user `0412209ee10a46558a8baf10b59f89a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:14.239337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b6da629c-6f26-49ab-9537-cd5df70f2457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:14.263575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 824/1656] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:46:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:14.281956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac3a8d-51e9-41fd-a6d3-a11dfbe1d383 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:14.305886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac3a8d-51e9-41fd-a6d3-a11dfbe1d383 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:14.324439 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047743e1-b1dd-4281-ab9c-e9af91687a27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:14.325318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047743e1-b1dd-4281-ab9c-e9af91687a27 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:14.325907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047743e1-b1dd-4281-ab9c-e9af91687a27 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:14.326380 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047743e1-b1dd-4281-ab9c-e9af91687a27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:14.343217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047743e1-b1dd-4281-ab9c-e9af91687a27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:14.347468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047743e1-b1dd-4281-ab9c-e9af91687a27 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:14.366756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 833/1657] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:15.258989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bb505-d454-4942-b586-1ff05db71235 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:15.260019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bb505-d454-4942-b586-1ff05db71235 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:15.260521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bb505-d454-4942-b586-1ff05db71235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:15.307271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-840bb505-d454-4942-b586-1ff05db71235 None None] MFA Rules not processed for user `cf98a4d33cab49b08640f437dbfb2dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:15.310231 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-840bb505-d454-4942-b586-1ff05db71235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:15.440562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:15.486835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 825/1658] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:15.509013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde2b21-87e2-45f3-b559-b8b114bb0591 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:15.509521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde2b21-87e2-45f3-b559-b8b114bb0591 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:15.512302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde2b21-87e2-45f3-b559-b8b114bb0591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:15.614023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7cde2b21-87e2-45f3-b559-b8b114bb0591 None None] MFA Rules not processed for user `cf98a4d33cab49b08640f437dbfb2dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:15.619657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7cde2b21-87e2-45f3-b559-b8b114bb0591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:15.641966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 834/1659] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:15.662518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bb505-d454-4942-b586-1ff05db71235 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:15.867481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bb505-d454-4942-b586-1ff05db71235 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:15.874540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbc5ab-047e-47c4-9b41-d58516976b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:15.875311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbc5ab-047e-47c4-9b41-d58516976b00 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:15.875671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbc5ab-047e-47c4-9b41-d58516976b00 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:15.875976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbc5ab-047e-47c4-9b41-d58516976b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:15.885532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbc5ab-047e-47c4-9b41-d58516976b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:15.887219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbc5ab-047e-47c4-9b41-d58516976b00 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:15.900857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 826/1660] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:16.450574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d56741-af21-4140-aecb-f03336c811af None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:16.451129 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d56741-af21-4140-aecb-f03336c811af None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:16.451605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d56741-af21-4140-aecb-f03336c811af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:16.521954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-77d56741-af21-4140-aecb-f03336c811af None None] MFA Rules not processed for user `0537911b91184fcdbdcc9e93ec3fe5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:16.523347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-77d56741-af21-4140-aecb-f03336c811af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:16.565592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbc5ab-047e-47c4-9b41-d58516976b00 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:16.584194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:16.731646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 835/1661] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:16.754822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d56741-af21-4140-aecb-f03336c811af None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:16.803734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d56741-af21-4140-aecb-f03336c811af None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:16.805766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbc5ab-047e-47c4-9b41-d58516976b00 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:16.830039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:16.830284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f960d6-834d-41a5-ad2f-10c3e2916820 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:16.831098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f960d6-834d-41a5-ad2f-10c3e2916820 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:16.831546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f960d6-834d-41a5-ad2f-10c3e2916820 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:16.831978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f960d6-834d-41a5-ad2f-10c3e2916820 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:16.832222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:16.832751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:16.833312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] PATH_INFO: `/v3/users/ed8b0bf54a5742989934a8c099c863d8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:16.844047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8b0bf54a5742989934a8c099c863d8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:16.844795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:16.855571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f960d6-834d-41a5-ad2f-10c3e2916820 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:16.860158 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f960d6-834d-41a5-ad2f-10c3e2916820 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:16.908398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 836/1662] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:17.361419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8b0bf54a5742989934a8c099c863d8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:17.529905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8b0bf54a5742989934a8c099c863d8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:17.531000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8b0bf54a5742989934a8c099c863d8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:17.535597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8b0bf54a5742989934a8c099c863d8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:17.559077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ffff41d1-2246-427e-ad09-a7bd18e9c70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8b0bf54a5742989934a8c099c863d8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:17.567450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:17.600876 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 827/1663] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:16 2022] DELETE /identity/v3/users/ed8b0bf54a5742989934a8c099c863d8 => generated 0 bytes in 1035 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:18.293830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae0f6-7536-4a9b-81ca-e471a764aeca None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:18.294710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae0f6-7536-4a9b-81ca-e471a764aeca None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:18.295277 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aae0f6-7536-4a9b-81ca-e471a764aeca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:18.370267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e7aae0f6-7536-4a9b-81ca-e471a764aeca None None] MFA Rules not processed for user `cf98a4d33cab49b08640f437dbfb2dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:18.374341 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e7aae0f6-7536-4a9b-81ca-e471a764aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:18.469014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 837/1664] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:18.696553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72acd-aac5-41dd-a838-8e96f6abedf0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:18.696553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72acd-aac5-41dd-a838-8e96f6abedf0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:18.696553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e72acd-aac5-41dd-a838-8e96f6abedf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:18.747083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e1e72acd-aac5-41dd-a838-8e96f6abedf0 None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:18.748422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e1e72acd-aac5-41dd-a838-8e96f6abedf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:18.959405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 828/1665] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:46:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:19.016612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae0f6-7536-4a9b-81ca-e471a764aeca None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:19.020571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e7aae0f6-7536-4a9b-81ca-e471a764aeca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:19.329627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aae0f6-7536-4a9b-81ca-e471a764aeca None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:19.340873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:19.341811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:19.342159 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:19.345709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] PATH_INFO: `/v3/projects/fc5815d8eef24db5b64a02ff8a4507e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:19.345709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5815d8eef24db5b64a02ff8a4507e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:19.346672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:19.360492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32b5cd-18cc-4aad-b757-a3bfa2a86412 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:19.360797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32b5cd-18cc-4aad-b757-a3bfa2a86412 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:19.361080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32b5cd-18cc-4aad-b757-a3bfa2a86412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:19.447426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7f32b5cd-18cc-4aad-b757-a3bfa2a86412 None None] MFA Rules not processed for user `1e83db01f0b24204a61b037b3c1f044c`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:19.448926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7f32b5cd-18cc-4aad-b757-a3bfa2a86412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:19.700951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5815d8eef24db5b64a02ff8a4507e3', 'request_id': 'req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:19.717082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:19.721881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5815d8eef24db5b64a02ff8a4507e3', 'request_id': 'req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:19.731942 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5815d8eef24db5b64a02ff8a4507e3', 'request_id': 'req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:19.747604 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 829/1666] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:19.747604 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32b5cd-18cc-4aad-b757-a3bfa2a86412 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:19.749361 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7f32b5cd-18cc-4aad-b757-a3bfa2a86412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:19.942842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] The token cache is being invalidate because project fc5815d8eef24db5b64a02ff8a4507e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:19.943776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:19.947929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:19.956957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 838/1667] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:19 2022] DELETE /identity/v3/projects/fc5815d8eef24db5b64a02ff8a4507e3 => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:19.964101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:19.965912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32b5cd-18cc-4aad-b757-a3bfa2a86412 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:19.973014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:20.126796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:20.169066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b170f8-cdf7-4dff-81f8-c4df16806b0e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:20.175092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:20.176135 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:20.176420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:20.176702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] PATH_INFO: `/v3/users/3fa1d79aebb94d259217ee6cf8073190` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:20.177955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fa1d79aebb94d259217ee6cf8073190)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:20.179925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: WARNING py.warnings [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:46:20.179925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: warnings.warn(msg) May 26 12:46:20.179925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: May 26 12:46:20.182254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:20.182986 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88ea92-e44d-4688-840e-a78f79c32638 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:20.184577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88ea92-e44d-4688-840e-a78f79c32638 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:20.185144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88ea92-e44d-4688-840e-a78f79c32638 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:20.185836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88ea92-e44d-4688-840e-a78f79c32638 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:20.190992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6b88ea92-e44d-4688-840e-a78f79c32638 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:20.492986 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88ea92-e44d-4688-840e-a78f79c32638 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:20.498837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b88ea92-e44d-4688-840e-a78f79c32638 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:20.534655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 830/1668] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:46:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:46:20.542233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88ea92-e44d-4688-840e-a78f79c32638 service swift] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:20.545116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6b88ea92-e44d-4688-840e-a78f79c32638 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:20.669371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fa1d79aebb94d259217ee6cf8073190'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:20.673622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fa1d79aebb94d259217ee6cf8073190'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:20.799040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b88ea92-e44d-4688-840e-a78f79c32638 service swift] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:20.811637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731531e-3f24-49f4-bd08-7e2d225cb998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:20.813998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731531e-3f24-49f4-bd08-7e2d225cb998 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:20.814088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731531e-3f24-49f4-bd08-7e2d225cb998 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:20.814741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731531e-3f24-49f4-bd08-7e2d225cb998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:20.818745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2731531e-3f24-49f4-bd08-7e2d225cb998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:20.833814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fa1d79aebb94d259217ee6cf8073190'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:20.835257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fa1d79aebb94d259217ee6cf8073190'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:20.936869 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fa1d79aebb94d259217ee6cf8073190'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:21.002873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 839/1669] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:19 2022] DELETE /identity/v3/users/3fa1d79aebb94d259217ee6cf8073190 => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:21.183112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731531e-3f24-49f4-bd08-7e2d225cb998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:21.187332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731531e-3f24-49f4-bd08-7e2d225cb998 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:21.243794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 831/1670] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:22.052708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:22.055453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:22.218376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1def2a69-fbf4-442f-b9df-b857185eab78 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:22.218376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:22.218376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:22.218376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:22.218687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] PATH_INFO: `/v3/users/d1a4623e202d4d359037fb958a4e1e7c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:22.218687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1a4623e202d4d359037fb958a4e1e7c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:22.218687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:22.297904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731531e-3f24-49f4-bd08-7e2d225cb998 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:22.300233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2731531e-3f24-49f4-bd08-7e2d225cb998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:22.323122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731531e-3f24-49f4-bd08-7e2d225cb998 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:22.340898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:22.341837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:22.342495 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:22.343091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] PATH_INFO: `/v3/projects/124fd15cdc844acf8bc9f72318470223` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:22.345261 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=124fd15cdc844acf8bc9f72318470223)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:22.346468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: WARNING py.warnings [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:46:22.346468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: warnings.warn(msg) May 26 12:46:22.346468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: May 26 12:46:22.348004 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:22.356636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:22.644240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124fd15cdc844acf8bc9f72318470223', 'request_id': 'req-74e52140-d472-4a73-86b6-d510a7b18240'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.652055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124fd15cdc844acf8bc9f72318470223', 'request_id': 'req-74e52140-d472-4a73-86b6-d510a7b18240'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.669350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124fd15cdc844acf8bc9f72318470223', 'request_id': 'req-74e52140-d472-4a73-86b6-d510a7b18240'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.887167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] The token cache is being invalidate because project 124fd15cdc844acf8bc9f72318470223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:22.887167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.887167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-74e52140-d472-4a73-86b6-d510a7b18240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.887167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 832/1671] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:22 2022] DELETE /identity/v3/projects/124fd15cdc844acf8bc9f72318470223 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:22.887167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aaf78-495b-4687-bc33-47e6b391cef7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:22.887686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aaf78-495b-4687-bc33-47e6b391cef7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:22.887686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5aaf78-495b-4687-bc33-47e6b391cef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:22.918521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1a4623e202d4d359037fb958a4e1e7c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.920853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1a4623e202d4d359037fb958a4e1e7c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:22.951397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3e5aaf78-495b-4687-bc33-47e6b391cef7 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:22.952676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3e5aaf78-495b-4687-bc33-47e6b391cef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:23.492090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 833/1672] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:23.492090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e80f4-fa7d-47e1-99c4-502a853d98aa None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:23.492090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e80f4-fa7d-47e1-99c4-502a853d98aa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:23.492090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3e80f4-fa7d-47e1-99c4-502a853d98aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:23.530372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ae3e80f4-fa7d-47e1-99c4-502a853d98aa None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:23.621849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ae3e80f4-fa7d-47e1-99c4-502a853d98aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:23.621849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 834/1673] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:23.623868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e80f4-fa7d-47e1-99c4-502a853d98aa None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:23.634244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3e80f4-fa7d-47e1-99c4-502a853d98aa None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:23.685137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281ee65-91fb-4f8c-9fab-5b30654ea2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:23.685828 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ee65-91fb-4f8c-9fab-5b30654ea2f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:23.686118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ee65-91fb-4f8c-9fab-5b30654ea2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:23.686435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281ee65-91fb-4f8c-9fab-5b30654ea2f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:23.687176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281ee65-91fb-4f8c-9fab-5b30654ea2f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:23.687488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281ee65-91fb-4f8c-9fab-5b30654ea2f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:23.691130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281ee65-91fb-4f8c-9fab-5b30654ea2f4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:23.707304 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 835/1674] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:46:23.712536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281ee65-91fb-4f8c-9fab-5b30654ea2f4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:23.729869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281ee65-91fb-4f8c-9fab-5b30654ea2f4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:23.736310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345178e-6a79-4c32-8fcf-d6a112d42c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:23.737030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345178e-6a79-4c32-8fcf-d6a112d42c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:23.737293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345178e-6a79-4c32-8fcf-d6a112d42c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:23.737576 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345178e-6a79-4c32-8fcf-d6a112d42c49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:23.738765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345178e-6a79-4c32-8fcf-d6a112d42c49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:23.741872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345178e-6a79-4c32-8fcf-d6a112d42c49 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:23.792128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1a4623e202d4d359037fb958a4e1e7c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:23.798384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1a4623e202d4d359037fb958a4e1e7c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:23.829903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c2774572-87f0-4cc9-a915-dc82f45b31ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1a4623e202d4d359037fb958a4e1e7c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:23.896006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 840/1675] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:22 2022] DELETE /identity/v3/users/d1a4623e202d4d359037fb958a4e1e7c => generated 0 bytes in 1844 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:23.902296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082888-1df6-400a-9196-5d2906e2b18f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:23.902592 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082888-1df6-400a-9196-5d2906e2b18f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:23.902867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082888-1df6-400a-9196-5d2906e2b18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:23.962249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 836/1676] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:23 2022] POST /identity/v3/projects => generated 369 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:46:23.963227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345178e-6a79-4c32-8fcf-d6a112d42c49 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:23.963514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-bd082888-1df6-400a-9196-5d2906e2b18f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:23.969779 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bd082888-1df6-400a-9196-5d2906e2b18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:24.105248 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 841/1677] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:24.121087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd082888-1df6-400a-9196-5d2906e2b18f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:24.122323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bd082888-1df6-400a-9196-5d2906e2b18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:24.151667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:24.315252 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345178e-6a79-4c32-8fcf-d6a112d42c49 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:24.325980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a7bda-839d-48b8-b02d-0064cba1f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:24.328920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7bda-839d-48b8-b02d-0064cba1f3fb admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:24.329293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7bda-839d-48b8-b02d-0064cba1f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:24.329578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a7bda-839d-48b8-b02d-0064cba1f3fb admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:24.331407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a7bda-839d-48b8-b02d-0064cba1f3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:24.358305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a7bda-839d-48b8-b02d-0064cba1f3fb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:24.374970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd082888-1df6-400a-9196-5d2906e2b18f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:24.388965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6b16f-f83b-4f7f-9d05-0cfb03f98643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:24.394418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b16f-f83b-4f7f-9d05-0cfb03f98643 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:24.394418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b16f-f83b-4f7f-9d05-0cfb03f98643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:24.394418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6b16f-f83b-4f7f-9d05-0cfb03f98643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:24.444277 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6b16f-f83b-4f7f-9d05-0cfb03f98643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:24.452860 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6b16f-f83b-4f7f-9d05-0cfb03f98643 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:24.509913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 842/1678] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:24.511588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97ed4-22a2-453b-9141-f3574739328d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:24.512276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97ed4-22a2-453b-9141-f3574739328d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:24.512276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd97ed4-22a2-453b-9141-f3574739328d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:24.587597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 837/1679] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:23 2022] POST /identity/v3/users => generated 285 bytes in 617 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:24.587597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4013c-62c6-44df-8abe-247f889afea8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:24.587597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4013c-62c6-44df-8abe-247f889afea8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:24.587597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4013c-62c6-44df-8abe-247f889afea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:24.609021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0dd97ed4-22a2-453b-9141-f3574739328d None None] MFA Rules not processed for user `d7a0dbcea7ef4cdd9134f4c5a9cf5fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:24.613306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0dd97ed4-22a2-453b-9141-f3574739328d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:24.636607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 843/1680] 10.222.0.42 () {58 vars in 1015 bytes} [Thu May 26 12:46:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:24.640755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97ed4-22a2-453b-9141-f3574739328d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:24.701304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd97ed4-22a2-453b-9141-f3574739328d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:24.759478 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c33d-cef3-4c08-a73c-5eb76ffb89ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:24.760015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c33d-cef3-4c08-a73c-5eb76ffb89ad admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:24.764606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c33d-cef3-4c08-a73c-5eb76ffb89ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:24.773914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa21c33d-cef3-4c08-a73c-5eb76ffb89ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:24.774800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21c33d-cef3-4c08-a73c-5eb76ffb89ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:24.777272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa21c33d-cef3-4c08-a73c-5eb76ffb89ad admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:24.835520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 844/1681] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:24.837152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c33d-cef3-4c08-a73c-5eb76ffb89ad admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:24.846462 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fa21c33d-cef3-4c08-a73c-5eb76ffb89ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:24.903686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa21c33d-cef3-4c08-a73c-5eb76ffb89ad admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:24.920343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738af50-c011-421b-8b2a-bf93ec52df05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:24.921613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738af50-c011-421b-8b2a-bf93ec52df05 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:24.922350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738af50-c011-421b-8b2a-bf93ec52df05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:24.922842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8738af50-c011-421b-8b2a-bf93ec52df05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:24.942932 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738af50-c011-421b-8b2a-bf93ec52df05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:24.946400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8738af50-c011-421b-8b2a-bf93ec52df05 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:24.974075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 845/1682] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:24.975935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738af50-c011-421b-8b2a-bf93ec52df05 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:25.029506 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8738af50-c011-421b-8b2a-bf93ec52df05 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:25.066547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5dcaa-4125-40a4-a9fa-a11a0775761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:25.067400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5dcaa-4125-40a4-a9fa-a11a0775761d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:25.069122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5dcaa-4125-40a4-a9fa-a11a0775761d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:25.084992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5dcaa-4125-40a4-a9fa-a11a0775761d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:25.085906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5dcaa-4125-40a4-a9fa-a11a0775761d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:25.087840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b5dcaa-4125-40a4-a9fa-a11a0775761d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:25.127084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 846/1683] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:25.133183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5dcaa-4125-40a4-a9fa-a11a0775761d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:25.187748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b5dcaa-4125-40a4-a9fa-a11a0775761d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:25.210425 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe637b4-5a8c-4204-a21c-a377435be38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:25.214984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe637b4-5a8c-4204-a21c-a377435be38c admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:25.218830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe637b4-5a8c-4204-a21c-a377435be38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:25.219429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe637b4-5a8c-4204-a21c-a377435be38c admin admin] PATH_INFO: `/v3/projects/0a9284dd8c1c498b8620b8bef3c2b368/users/8aff39bef90440baaaec36b522c15a11/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:25.262347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-78c4013c-62c6-44df-8abe-247f889afea8 None None] MFA Rules not processed for user `0537911b91184fcdbdcc9e93ec3fe5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:25.270648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-78c4013c-62c6-44df-8abe-247f889afea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:25.287284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe637b4-5a8c-4204-a21c-a377435be38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9284dd8c1c498b8620b8bef3c2b368, user_id=8aff39bef90440baaaec36b522c15a11, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:25.295340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe637b4-5a8c-4204-a21c-a377435be38c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:25.485271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 838/1684] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 904 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:25.534811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 847/1685] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:25 2022] PUT /identity/v3/projects/0a9284dd8c1c498b8620b8bef3c2b368/users/8aff39bef90440baaaec36b522c15a11/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:25.545552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e39c7f-b41f-4057-ab88-ff98b50ee4a5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:25.546368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e39c7f-b41f-4057-ab88-ff98b50ee4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:25.546934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e39c7f-b41f-4057-ab88-ff98b50ee4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:25.675649 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d9e39c7f-b41f-4057-ab88-ff98b50ee4a5 None None] MFA Rules not processed for user `8aff39bef90440baaaec36b522c15a11`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:25.678442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d9e39c7f-b41f-4057-ab88-ff98b50ee4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:25.949083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 839/1686] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:25.955234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe637b4-5a8c-4204-a21c-a377435be38c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:26.148436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:26.241151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe637b4-5a8c-4204-a21c-a377435be38c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:26.260164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bada8f3-bc8c-4692-a593-ae9d990abbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:26.260164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bada8f3-bc8c-4692-a593-ae9d990abbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:26.260164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bada8f3-bc8c-4692-a593-ae9d990abbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:26.260164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bada8f3-bc8c-4692-a593-ae9d990abbd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:26.260554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bada8f3-bc8c-4692-a593-ae9d990abbd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:26.264191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bada8f3-bc8c-4692-a593-ae9d990abbd3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:26.612630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 848/1687] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:25 2022] POST /identity/v3/projects => generated 367 bytes in 659 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:26.616988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e39c7f-b41f-4057-ab88-ff98b50ee4a5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:26.635049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e39c7f-b41f-4057-ab88-ff98b50ee4a5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:26.805562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42222c38-339b-4c22-9d1e-e5382db9795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:26.805562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42222c38-339b-4c22-9d1e-e5382db9795f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:26.805562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42222c38-339b-4c22-9d1e-e5382db9795f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:26.805562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42222c38-339b-4c22-9d1e-e5382db9795f admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:26.806479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42222c38-339b-4c22-9d1e-e5382db9795f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:26.807804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42222c38-339b-4c22-9d1e-e5382db9795f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:27.018137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 840/1688] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:26 2022] POST /identity/v3/users => generated 290 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:46:27.022343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bada8f3-bc8c-4692-a593-ae9d990abbd3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:27.044219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bada8f3-bc8c-4692-a593-ae9d990abbd3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:27.062471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f98e-dfdb-4711-b730-f3312963eb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:27.063189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f98e-dfdb-4711-b730-f3312963eb9d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:27.066096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f98e-dfdb-4711-b730-f3312963eb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:27.066604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1f98e-dfdb-4711-b730-f3312963eb9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:27.067541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1f98e-dfdb-4711-b730-f3312963eb9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:27.069479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1f98e-dfdb-4711-b730-f3312963eb9d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:27.123903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 849/1689] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:27.137837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42222c38-339b-4c22-9d1e-e5382db9795f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:27.151999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42222c38-339b-4c22-9d1e-e5382db9795f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:27.181303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42593759-9b25-48cd-a9cb-575436b6867c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:27.197050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42593759-9b25-48cd-a9cb-575436b6867c admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:27.197050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42593759-9b25-48cd-a9cb-575436b6867c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:27.197050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42593759-9b25-48cd-a9cb-575436b6867c admin admin] PATH_INFO: `/v3/projects/2170b73ca44b4400aad5e98350c0b317/users/401b484e0ea347aba9426d911e4989ff/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:27.239292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42593759-9b25-48cd-a9cb-575436b6867c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2170b73ca44b4400aad5e98350c0b317, user_id=401b484e0ea347aba9426d911e4989ff, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:27.248084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42593759-9b25-48cd-a9cb-575436b6867c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:27.648279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 841/1690] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:27 2022] PUT /identity/v3/projects/2170b73ca44b4400aad5e98350c0b317/users/401b484e0ea347aba9426d911e4989ff/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:27.648487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f98e-dfdb-4711-b730-f3312963eb9d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:27.653816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e9e1f98e-dfdb-4711-b730-f3312963eb9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:27.665082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42593759-9b25-48cd-a9cb-575436b6867c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:27.697117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1f98e-dfdb-4711-b730-f3312963eb9d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:27.904636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42593759-9b25-48cd-a9cb-575436b6867c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:27.924689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef7e24-e8b8-406a-91b4-18636eb90b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:27.925535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef7e24-e8b8-406a-91b4-18636eb90b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:27.936167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef7e24-e8b8-406a-91b4-18636eb90b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:27.936167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef7e24-e8b8-406a-91b4-18636eb90b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:27.936167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef7e24-e8b8-406a-91b4-18636eb90b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:27.936167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef7e24-e8b8-406a-91b4-18636eb90b6b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:27.938882 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:27.945128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:27.946663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:27.946963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] PATH_INFO: `/v3/projects/fae36bb3997f4f14b8f1a0bcaf0fca1a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:27.951265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fae36bb3997f4f14b8f1a0bcaf0fca1a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:27.959540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:27.977394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 842/1691] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:27.994635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef7e24-e8b8-406a-91b4-18636eb90b6b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:28.029704 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef7e24-e8b8-406a-91b4-18636eb90b6b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:28.037817 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b09c4b-8a69-4dcd-bbe3-2cba84b644f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:28.040096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09c4b-8a69-4dcd-bbe3-2cba84b644f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:28.040758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09c4b-8a69-4dcd-bbe3-2cba84b644f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:28.041251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b09c4b-8a69-4dcd-bbe3-2cba84b644f8 admin admin] PATH_INFO: `/v3/projects/2170b73ca44b4400aad5e98350c0b317/users/401b484e0ea347aba9426d911e4989ff/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:28.045135 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b09c4b-8a69-4dcd-bbe3-2cba84b644f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2170b73ca44b4400aad5e98350c0b317, user_id=401b484e0ea347aba9426d911e4989ff, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:28.048788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b09c4b-8a69-4dcd-bbe3-2cba84b644f8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:28.102366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 843/1692] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:27 2022] PUT /identity/v3/projects/2170b73ca44b4400aad5e98350c0b317/users/401b484e0ea347aba9426d911e4989ff/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:28.114783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfbb0a-e158-4f26-9bd6-f9fca094f97a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:28.116797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfbb0a-e158-4f26-9bd6-f9fca094f97a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:28.117875 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dfbb0a-e158-4f26-9bd6-f9fca094f97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:28.191941 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-20dfbb0a-e158-4f26-9bd6-f9fca094f97a None None] MFA Rules not processed for user `401b484e0ea347aba9426d911e4989ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:28.194451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-20dfbb0a-e158-4f26-9bd6-f9fca094f97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:28.319068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fae36bb3997f4f14b8f1a0bcaf0fca1a', 'request_id': 'req-8133388b-e715-4709-9437-5232dd4311cf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:28.345845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fae36bb3997f4f14b8f1a0bcaf0fca1a', 'request_id': 'req-8133388b-e715-4709-9437-5232dd4311cf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:28.372830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 844/1693] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:28.381469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fae36bb3997f4f14b8f1a0bcaf0fca1a', 'request_id': 'req-8133388b-e715-4709-9437-5232dd4311cf'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:28.390068 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfbb0a-e158-4f26-9bd6-f9fca094f97a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:28.392023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-20dfbb0a-e158-4f26-9bd6-f9fca094f97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:28.521036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dfbb0a-e158-4f26-9bd6-f9fca094f97a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:28.642431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f75d6-61f1-41de-9d68-3e44f68d2a37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:28.645121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f75d6-61f1-41de-9d68-3e44f68d2a37 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:28.645852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f75d6-61f1-41de-9d68-3e44f68d2a37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:28.646506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f75d6-61f1-41de-9d68-3e44f68d2a37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:28.709550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] The token cache is being invalidate because project fae36bb3997f4f14b8f1a0bcaf0fca1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:28.719347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:28.719347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8133388b-e715-4709-9437-5232dd4311cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:28.719347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 850/1694] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:27 2022] DELETE /identity/v3/projects/fae36bb3997f4f14b8f1a0bcaf0fca1a => generated 0 bytes in 1071 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:28.720053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea36d1a-f2a6-4a3f-a9fa-bbc5426f94d8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:28.720242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea36d1a-f2a6-4a3f-a9fa-bbc5426f94d8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:28.720624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea36d1a-f2a6-4a3f-a9fa-bbc5426f94d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:28.778173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6ea36d1a-f2a6-4a3f-a9fa-bbc5426f94d8 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:28.783436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6ea36d1a-f2a6-4a3f-a9fa-bbc5426f94d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:28.904057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f75d6-61f1-41de-9d68-3e44f68d2a37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:28.906715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f75d6-61f1-41de-9d68-3e44f68d2a37 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:28.939098 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 845/1695] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:28.940544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f75d6-61f1-41de-9d68-3e44f68d2a37 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:28.942767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a68f75d6-61f1-41de-9d68-3e44f68d2a37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:29.025918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 851/1696] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:29.028106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20719-bf46-4218-86b0-c2508ba21694 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:29.031284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20719-bf46-4218-86b0-c2508ba21694 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:29.031793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a20719-bf46-4218-86b0-c2508ba21694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:29.074311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-60a20719-bf46-4218-86b0-c2508ba21694 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:29.074311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-60a20719-bf46-4218-86b0-c2508ba21694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:29.139614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 852/1697] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:29.151914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20719-bf46-4218-86b0-c2508ba21694 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:29.177806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a20719-bf46-4218-86b0-c2508ba21694 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:29.204400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc5834-f340-42c5-8fcc-2788b6a954c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:29.208343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc5834-f340-42c5-8fcc-2788b6a954c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:29.211551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc5834-f340-42c5-8fcc-2788b6a954c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:29.211910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc5834-f340-42c5-8fcc-2788b6a954c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:29.217345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc5834-f340-42c5-8fcc-2788b6a954c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:29.217753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc5834-f340-42c5-8fcc-2788b6a954c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:29.237800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc5834-f340-42c5-8fcc-2788b6a954c2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:29.261275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f75d6-61f1-41de-9d68-3e44f68d2a37 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:29.268138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:29.269366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:29.269950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:29.270422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] PATH_INFO: `/v3/users/57231ab43d4941a1b12a5171d1fff843` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:29.272384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57231ab43d4941a1b12a5171d1fff843)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:29.275483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:29.282347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 853/1698] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:46:29.287208 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc5834-f340-42c5-8fcc-2788b6a954c2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:29.333169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc5834-f340-42c5-8fcc-2788b6a954c2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:29.355906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7553aa-27ff-4932-bb4c-dfca81da5fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:29.356559 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7553aa-27ff-4932-bb4c-dfca81da5fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:29.356852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7553aa-27ff-4932-bb4c-dfca81da5fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:29.357132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7553aa-27ff-4932-bb4c-dfca81da5fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:29.357865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7553aa-27ff-4932-bb4c-dfca81da5fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:29.360026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7553aa-27ff-4932-bb4c-dfca81da5fc4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:29.565033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 854/1699] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:29 2022] POST /identity/v3/projects => generated 373 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:46:29.569760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7553aa-27ff-4932-bb4c-dfca81da5fc4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:29.629303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57231ab43d4941a1b12a5171d1fff843'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:29.725006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57231ab43d4941a1b12a5171d1fff843'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:29.726103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57231ab43d4941a1b12a5171d1fff843'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:29.727646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57231ab43d4941a1b12a5171d1fff843'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:29.747299 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b26cdd47-2413-43c6-b3cf-6f1392574fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57231ab43d4941a1b12a5171d1fff843'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:29.802385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7553aa-27ff-4932-bb4c-dfca81da5fc4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:29.811305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725526-3a2b-4762-a8d0-c877b8edcc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:29.812140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725526-3a2b-4762-a8d0-c877b8edcc04 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:29.812466 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725526-3a2b-4762-a8d0-c877b8edcc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:29.812840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90725526-3a2b-4762-a8d0-c877b8edcc04 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:29.813647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90725526-3a2b-4762-a8d0-c877b8edcc04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:29.816078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90725526-3a2b-4762-a8d0-c877b8edcc04 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:29.817705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 846/1700] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:28 2022] DELETE /identity/v3/users/57231ab43d4941a1b12a5171d1fff843 => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:29.824661 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58808-2ada-4300-8833-a8bf26edba36 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:29.827117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58808-2ada-4300-8833-a8bf26edba36 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:29.830356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58808-2ada-4300-8833-a8bf26edba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:29.921318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a3f58808-2ada-4300-8833-a8bf26edba36 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:29.923633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a3f58808-2ada-4300-8833-a8bf26edba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:29.958174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 855/1701] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:29 2022] POST /identity/v3/users => generated 287 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:29.959413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725526-3a2b-4762-a8d0-c877b8edcc04 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:29.965175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-90725526-3a2b-4762-a8d0-c877b8edcc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:30.000463 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90725526-3a2b-4762-a8d0-c877b8edcc04 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:30.200384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 847/1702] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:30.211203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c6ded-5bd7-490f-bb03-d09576e44209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:30.211916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c6ded-5bd7-490f-bb03-d09576e44209 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:30.212206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c6ded-5bd7-490f-bb03-d09576e44209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:30.212489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c6ded-5bd7-490f-bb03-d09576e44209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:30.213245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c6ded-5bd7-490f-bb03-d09576e44209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:30.213640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58808-2ada-4300-8833-a8bf26edba36 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:30.215292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a3f58808-2ada-4300-8833-a8bf26edba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:30.223533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c6ded-5bd7-490f-bb03-d09576e44209 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:30.254669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 856/1703] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:30.261550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c6ded-5bd7-490f-bb03-d09576e44209 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:30.274791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c6ded-5bd7-490f-bb03-d09576e44209 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:30.287347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe2d90-b66f-404c-aba3-8aa6218dc8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:30.288322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2d90-b66f-404c-aba3-8aa6218dc8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:30.308444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2d90-b66f-404c-aba3-8aa6218dc8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:30.308993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2d90-b66f-404c-aba3-8aa6218dc8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:30.309960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe2d90-b66f-404c-aba3-8aa6218dc8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:30.328455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe2d90-b66f-404c-aba3-8aa6218dc8c3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:30.340513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 857/1704] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:30.344630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe2d90-b66f-404c-aba3-8aa6218dc8c3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:30.363738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe2d90-b66f-404c-aba3-8aa6218dc8c3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:30.365829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58808-2ada-4300-8833-a8bf26edba36 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:30.373298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2cce7-2a45-47c2-bc64-c0274609c49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:30.375389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2cce7-2a45-47c2-bc64-c0274609c49c service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:30.375835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2cce7-2a45-47c2-bc64-c0274609c49c service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:30.376596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2cce7-2a45-47c2-bc64-c0274609c49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:30.393230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb080e3-3cbd-46ff-964d-703b44688553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:30.394291 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb080e3-3cbd-46ff-964d-703b44688553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:30.399123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb080e3-3cbd-46ff-964d-703b44688553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:30.402297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb080e3-3cbd-46ff-964d-703b44688553 admin admin] PATH_INFO: `/v3/projects/29c430d6cb8e4e02871d8beebadde414/users/7097a6336a6943dbb30fc4d531adb9fb/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:30.408355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2cce7-2a45-47c2-bc64-c0274609c49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:30.409974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2cce7-2a45-47c2-bc64-c0274609c49c service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:30.449996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 848/1705] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:30.493085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb080e3-3cbd-46ff-964d-703b44688553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c430d6cb8e4e02871d8beebadde414, user_id=7097a6336a6943dbb30fc4d531adb9fb, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:30.509544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb080e3-3cbd-46ff-964d-703b44688553 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:30.668512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 858/1706] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:30 2022] PUT /identity/v3/projects/29c430d6cb8e4e02871d8beebadde414/users/7097a6336a6943dbb30fc4d531adb9fb/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:30.680579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1c31-ec00-4536-ac8c-ab64ccea50e2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:30.680878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1c31-ec00-4536-ac8c-ab64ccea50e2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:30.681173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee1c31-ec00-4536-ac8c-ab64ccea50e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:30.712408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7bee1c31-ec00-4536-ac8c-ab64ccea50e2 None None] MFA Rules not processed for user `7097a6336a6943dbb30fc4d531adb9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:30.713805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7bee1c31-ec00-4536-ac8c-ab64ccea50e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:30.841828 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 849/1707] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:30.851659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb080e3-3cbd-46ff-964d-703b44688553 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:30.853981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bcb080e3-3cbd-46ff-964d-703b44688553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:30.890383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:30.980820 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb080e3-3cbd-46ff-964d-703b44688553 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:30.989051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb685f-210a-4aa9-a8c3-8094688f307d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:30.990405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb685f-210a-4aa9-a8c3-8094688f307d service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:30.990405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb685f-210a-4aa9-a8c3-8094688f307d service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:30.990664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb685f-210a-4aa9-a8c3-8094688f307d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:31.004616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb685f-210a-4aa9-a8c3-8094688f307d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:31.007442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb685f-210a-4aa9-a8c3-8094688f307d service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:31.019090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 859/1708] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:31.135753 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1c31-ec00-4536-ac8c-ab64ccea50e2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:31.139955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7bee1c31-ec00-4536-ac8c-ab64ccea50e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:31.174937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684d01b-02e0-4b79-b0a5-fbcd308b7804 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:31.175646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684d01b-02e0-4b79-b0a5-fbcd308b7804 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:31.176436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684d01b-02e0-4b79-b0a5-fbcd308b7804 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:31.179963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 860/1709] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:46:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:46:31.191696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60ac95-833e-47b2-8382-f10e2a4502c9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:31.192150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60ac95-833e-47b2-8382-f10e2a4502c9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:31.192709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60ac95-833e-47b2-8382-f10e2a4502c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:31.220153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ff60ac95-833e-47b2-8382-f10e2a4502c9 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:31.222116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ff60ac95-833e-47b2-8382-f10e2a4502c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:31.238556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 861/1710] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:46:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:31.272979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60ac95-833e-47b2-8382-f10e2a4502c9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:31.276613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ff60ac95-833e-47b2-8382-f10e2a4502c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:31.293456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60ac95-833e-47b2-8382-f10e2a4502c9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:31.303967 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053713d-7afb-4552-b1fd-f783c0e49f02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:31.304710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053713d-7afb-4552-b1fd-f783c0e49f02 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:31.305014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053713d-7afb-4552-b1fd-f783c0e49f02 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:31.305287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053713d-7afb-4552-b1fd-f783c0e49f02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:31.309134 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee1c31-ec00-4536-ac8c-ab64ccea50e2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:31.315423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053713d-7afb-4552-b1fd-f783c0e49f02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:31.317091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053713d-7afb-4552-b1fd-f783c0e49f02 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:31.317628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:31.318546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:31.318837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:31.319164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] PATH_INFO: `/v3/projects/580cb4752e7342ff8939e1fafc00a160` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:31.321781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=580cb4752e7342ff8939e1fafc00a160)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:31.324473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:31.331106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 862/1711] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:31.496343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '580cb4752e7342ff8939e1fafc00a160', 'request_id': 'req-ece81798-298c-4659-81fa-397ab8ca2a95'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:31.523983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '580cb4752e7342ff8939e1fafc00a160', 'request_id': 'req-ece81798-298c-4659-81fa-397ab8ca2a95'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:31.525709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '580cb4752e7342ff8939e1fafc00a160', 'request_id': 'req-ece81798-298c-4659-81fa-397ab8ca2a95'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:31.706681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ca72-05e0-4dbf-a6e1-cd72b21592e9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:31.707227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ca72-05e0-4dbf-a6e1-cd72b21592e9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:31.707446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4ca72-05e0-4dbf-a6e1-cd72b21592e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:31.733037 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] The token cache is being invalidate because project 580cb4752e7342ff8939e1fafc00a160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:31.733301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:31.734407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ece81798-298c-4659-81fa-397ab8ca2a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:31.741457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 850/1712] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:31 2022] DELETE /identity/v3/projects/580cb4752e7342ff8939e1fafc00a160 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:31.743517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36e89d-e3ec-44c9-9b58-aad6c5507cfa None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:31.743944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36e89d-e3ec-44c9-9b58-aad6c5507cfa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:31.744266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36e89d-e3ec-44c9-9b58-aad6c5507cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:31.767562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-20a4ca72-05e0-4dbf-a6e1-cd72b21592e9 None None] MFA Rules not processed for user `1e83db01f0b24204a61b037b3c1f044c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:31.769785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-20a4ca72-05e0-4dbf-a6e1-cd72b21592e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:31.791130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8f36e89d-e3ec-44c9-9b58-aad6c5507cfa None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:31.793345 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8f36e89d-e3ec-44c9-9b58-aad6c5507cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:31.856242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:31.935686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 851/1713] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:31.939747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 863/1714] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:31.968937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4797db0-41af-4568-9aa5-94c872dfadc2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:31.973037 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4797db0-41af-4568-9aa5-94c872dfadc2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:31.974458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4797db0-41af-4568-9aa5-94c872dfadc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:32.092031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a4797db0-41af-4568-9aa5-94c872dfadc2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:32.093295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a4797db0-41af-4568-9aa5-94c872dfadc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:32.140935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 852/1715] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:32.142502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ca72-05e0-4dbf-a6e1-cd72b21592e9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:32.169012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4ca72-05e0-4dbf-a6e1-cd72b21592e9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:32.190503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7561d87-2000-4d1a-92d2-38b440c3798d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:32.191772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7561d87-2000-4d1a-92d2-38b440c3798d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:32.192224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7561d87-2000-4d1a-92d2-38b440c3798d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:32.192695 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7561d87-2000-4d1a-92d2-38b440c3798d admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:32.193613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7561d87-2000-4d1a-92d2-38b440c3798d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:32.194238 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7561d87-2000-4d1a-92d2-38b440c3798d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:32.196611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7561d87-2000-4d1a-92d2-38b440c3798d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:32.251701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 864/1716] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:46:32.256221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4797db0-41af-4568-9aa5-94c872dfadc2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:32.283995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4797db0-41af-4568-9aa5-94c872dfadc2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:32.329300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5ae20-21da-4668-9fe1-4f775d2c4332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:32.332748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5ae20-21da-4668-9fe1-4f775d2c4332 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:32.339248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5ae20-21da-4668-9fe1-4f775d2c4332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:32.345530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5ae20-21da-4668-9fe1-4f775d2c4332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:32.346553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5ae20-21da-4668-9fe1-4f775d2c4332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:32.353546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5ae20-21da-4668-9fe1-4f775d2c4332 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:32.525689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 853/1717] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:32 2022] POST /identity/v3/projects => generated 403 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:32.529444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7561d87-2000-4d1a-92d2-38b440c3798d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:32.543953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7561d87-2000-4d1a-92d2-38b440c3798d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:32.720353 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd08d8-486f-4f32-ac7e-84a5efcad0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:32.721979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd08d8-486f-4f32-ac7e-84a5efcad0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:32.722406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd08d8-486f-4f32-ac7e-84a5efcad0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:32.722823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd08d8-486f-4f32-ac7e-84a5efcad0f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:32.723777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd08d8-486f-4f32-ac7e-84a5efcad0f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:32.732997 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd08d8-486f-4f32-ac7e-84a5efcad0f0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:32.887708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 865/1718] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:32 2022] POST /identity/v3/users => generated 302 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:32.892039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5ae20-21da-4668-9fe1-4f775d2c4332 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:32.909939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5ae20-21da-4668-9fe1-4f775d2c4332 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:32.936652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbf561-1ffc-4734-96e1-f3837972afc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:32.937843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf561-1ffc-4734-96e1-f3837972afc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:32.939324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf561-1ffc-4734-96e1-f3837972afc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:32.939828 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbf561-1ffc-4734-96e1-f3837972afc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:32.940944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbf561-1ffc-4734-96e1-f3837972afc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:32.942791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbf561-1ffc-4734-96e1-f3837972afc3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:32.980035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd08d8-486f-4f32-ac7e-84a5efcad0f0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:32.980681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 854/1719] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:32.993075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd08d8-486f-4f32-ac7e-84a5efcad0f0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:33.000989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13147287-92ca-47bd-8e59-636a9469f9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:33.001768 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13147287-92ca-47bd-8e59-636a9469f9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:33.002027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13147287-92ca-47bd-8e59-636a9469f9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:33.002341 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13147287-92ca-47bd-8e59-636a9469f9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:33.003823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13147287-92ca-47bd-8e59-636a9469f9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:33.005993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13147287-92ca-47bd-8e59-636a9469f9d4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:33.029013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 866/1720] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:33.030854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbf561-1ffc-4734-96e1-f3837972afc3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:33.044305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbf561-1ffc-4734-96e1-f3837972afc3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:33.051089 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bc24-a64f-4783-b390-8aee61c3bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:33.052194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bc24-a64f-4783-b390-8aee61c3bbd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:33.052336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bc24-a64f-4783-b390-8aee61c3bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:33.052737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1bc24-a64f-4783-b390-8aee61c3bbd2 admin admin] PATH_INFO: `/v3/projects/9bdf4fbfe8ef41a6899fac86c555beff/users/dc5d3dad764944cbb6201d6ac68b4cb1/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:33.075487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1bc24-a64f-4783-b390-8aee61c3bbd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdf4fbfe8ef41a6899fac86c555beff, user_id=dc5d3dad764944cbb6201d6ac68b4cb1, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:33.079221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1bc24-a64f-4783-b390-8aee61c3bbd2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:33.242429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 855/1721] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:33 2022] PUT /identity/v3/projects/9bdf4fbfe8ef41a6899fac86c555beff/users/dc5d3dad764944cbb6201d6ac68b4cb1/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:33.257217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55b424-8040-4689-8ecc-bd217b1a90da None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:33.259806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55b424-8040-4689-8ecc-bd217b1a90da None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:33.259806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55b424-8040-4689-8ecc-bd217b1a90da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:33.340629 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-da55b424-8040-4689-8ecc-bd217b1a90da None None] MFA Rules not processed for user `dc5d3dad764944cbb6201d6ac68b4cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:33.341928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-da55b424-8040-4689-8ecc-bd217b1a90da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:33.497369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 867/1722] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:33.503723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bc24-a64f-4783-b390-8aee61c3bbd2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:33.650912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1bc24-a64f-4783-b390-8aee61c3bbd2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:33.670088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7abe7c7-2e0c-4582-bd36-2fc427e668f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:33.670088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abe7c7-2e0c-4582-bd36-2fc427e668f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:33.670088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abe7c7-2e0c-4582-bd36-2fc427e668f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:33.670088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7abe7c7-2e0c-4582-bd36-2fc427e668f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:33.670355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abe7c7-2e0c-4582-bd36-2fc427e668f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:33.670355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7abe7c7-2e0c-4582-bd36-2fc427e668f2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:33.810480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 856/1723] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:33 2022] POST /identity/v3/projects => generated 405 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:33.814130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55b424-8040-4689-8ecc-bd217b1a90da None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:33.835632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55b424-8040-4689-8ecc-bd217b1a90da None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:34.040905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb522867-c24e-44a7-b28c-db7a9de7f7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:34.041620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb522867-c24e-44a7-b28c-db7a9de7f7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:34.042016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb522867-c24e-44a7-b28c-db7a9de7f7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:34.042302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb522867-c24e-44a7-b28c-db7a9de7f7e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:34.043028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb522867-c24e-44a7-b28c-db7a9de7f7e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:34.044993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb522867-c24e-44a7-b28c-db7a9de7f7e0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:34.131601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368062-01e8-42ec-beb9-10944c2e7b08 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:34.133450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368062-01e8-42ec-beb9-10944c2e7b08 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:34.133838 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd368062-01e8-42ec-beb9-10944c2e7b08 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:34.138399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 857/1724] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:46:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:46:34.194423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f687-1c7a-4ad7-a01f-9595bafa78d0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:34.197208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f687-1c7a-4ad7-a01f-9595bafa78d0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:34.199065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942f687-1c7a-4ad7-a01f-9595bafa78d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:34.256086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 868/1725] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:33 2022] POST /identity/v3/users => generated 309 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:34.261299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb522867-c24e-44a7-b28c-db7a9de7f7e0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:34.297247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9942f687-1c7a-4ad7-a01f-9595bafa78d0 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:34.302827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9942f687-1c7a-4ad7-a01f-9595bafa78d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:34.325150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb522867-c24e-44a7-b28c-db7a9de7f7e0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:34.355618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1463a5b-1751-497b-95c8-cac4e3d673e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:34.371679 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1463a5b-1751-497b-95c8-cac4e3d673e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:34.372022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1463a5b-1751-497b-95c8-cac4e3d673e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:34.372324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1463a5b-1751-497b-95c8-cac4e3d673e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:34.388458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1463a5b-1751-497b-95c8-cac4e3d673e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:34.393806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1463a5b-1751-497b-95c8-cac4e3d673e5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:34.432624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 869/1726] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:34.437275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1463a5b-1751-497b-95c8-cac4e3d673e5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:34.483682 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1463a5b-1751-497b-95c8-cac4e3d673e5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:34.505306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d29d4-ee7b-4fce-a774-c9b3775f46c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:34.507518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d29d4-ee7b-4fce-a774-c9b3775f46c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:34.509791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d29d4-ee7b-4fce-a774-c9b3775f46c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:34.510575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d29d4-ee7b-4fce-a774-c9b3775f46c5 admin admin] PATH_INFO: `/v3/projects/807ef2472d9b46b08737b8877e368175/users/09cc55996e094238ac63a6354d6738eb/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:34.542000 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d29d4-ee7b-4fce-a774-c9b3775f46c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807ef2472d9b46b08737b8877e368175, user_id=09cc55996e094238ac63a6354d6738eb, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:34.548181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d29d4-ee7b-4fce-a774-c9b3775f46c5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:34.596680 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 858/1727] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:46:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:34.645057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:34.691855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 870/1728] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:34 2022] PUT /identity/v3/projects/807ef2472d9b46b08737b8877e368175/users/09cc55996e094238ac63a6354d6738eb/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:34.697902 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942f687-1c7a-4ad7-a01f-9595bafa78d0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:34.722656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942f687-1c7a-4ad7-a01f-9595bafa78d0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:34.835780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510a6c8-3cce-4ad5-8546-26f3bbdbef91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:34.837013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a6c8-3cce-4ad5-8546-26f3bbdbef91 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:34.837405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a6c8-3cce-4ad5-8546-26f3bbdbef91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:34.838392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a6c8-3cce-4ad5-8546-26f3bbdbef91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:34.839481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510a6c8-3cce-4ad5-8546-26f3bbdbef91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:34.841857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a510a6c8-3cce-4ad5-8546-26f3bbdbef91 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:34.858400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 859/1729] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:34 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:34.860409 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d29d4-ee7b-4fce-a774-c9b3775f46c5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:34.873454 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d29d4-ee7b-4fce-a774-c9b3775f46c5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:34.880029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75198734-c30e-420f-8e2d-51b2498e6a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:34.881276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75198734-c30e-420f-8e2d-51b2498e6a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:34.881742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75198734-c30e-420f-8e2d-51b2498e6a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:34.882196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75198734-c30e-420f-8e2d-51b2498e6a88 admin admin] PATH_INFO: `/v3/projects/807ef2472d9b46b08737b8877e368175/users/09cc55996e094238ac63a6354d6738eb/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:34.886395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75198734-c30e-420f-8e2d-51b2498e6a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807ef2472d9b46b08737b8877e368175, user_id=09cc55996e094238ac63a6354d6738eb, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:34.890013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75198734-c30e-420f-8e2d-51b2498e6a88 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:34.913044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510a6c8-3cce-4ad5-8546-26f3bbdbef91 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:34.915993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a510a6c8-3cce-4ad5-8546-26f3bbdbef91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:34.935411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 871/1730] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:34 2022] PUT /identity/v3/projects/807ef2472d9b46b08737b8877e368175/users/09cc55996e094238ac63a6354d6738eb/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:34.944994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a510a6c8-3cce-4ad5-8546-26f3bbdbef91 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:34.948791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac4b39-72d7-4488-aef4-4f259120c614 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:34.948791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac4b39-72d7-4488-aef4-4f259120c614 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:34.948791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac4b39-72d7-4488-aef4-4f259120c614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:35.007142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-28ac4b39-72d7-4488-aef4-4f259120c614 None None] MFA Rules not processed for user `09cc55996e094238ac63a6354d6738eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:35.009511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-28ac4b39-72d7-4488-aef4-4f259120c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:35.094486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:35.095738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:35.095910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:35.096163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] PATH_INFO: `/v3/users/8aff39bef90440baaaec36b522c15a11` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:35.101898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aff39bef90440baaaec36b522c15a11)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:35.104299 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:35.200065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 872/1731] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:34 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:35.215310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac4b39-72d7-4488-aef4-4f259120c614 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:35.217142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-28ac4b39-72d7-4488-aef4-4f259120c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:35.270722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:35.387591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac4b39-72d7-4488-aef4-4f259120c614 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:35.399088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283eb294-b728-4491-be58-bca8eb0a4dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:35.400121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283eb294-b728-4491-be58-bca8eb0a4dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:35.400622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283eb294-b728-4491-be58-bca8eb0a4dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:35.402028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283eb294-b728-4491-be58-bca8eb0a4dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:35.419778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aff39bef90440baaaec36b522c15a11'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:35.427580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283eb294-b728-4491-be58-bca8eb0a4dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:35.432634 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283eb294-b728-4491-be58-bca8eb0a4dd9 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:35.463901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 873/1732] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:35 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:35.547968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aff39bef90440baaaec36b522c15a11'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:35.549244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aff39bef90440baaaec36b522c15a11'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:35.550830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aff39bef90440baaaec36b522c15a11'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:35.602057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aff39bef90440baaaec36b522c15a11'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:35.658184 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c312ebf-f38d-4cf0-9d38-69d7b17cce94 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:35.658729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c312ebf-f38d-4cf0-9d38-69d7b17cce94 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:35.659158 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c312ebf-f38d-4cf0-9d38-69d7b17cce94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:35.667961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 860/1733] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:34 2022] DELETE /identity/v3/users/8aff39bef90440baaaec36b522c15a11 => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:35.724520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9c312ebf-f38d-4cf0-9d38-69d7b17cce94 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:35.732377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9c312ebf-f38d-4cf0-9d38-69d7b17cce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:35.733587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:35.735155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:35.967969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6879c51-da38-4e09-a618-55f0e9f2bceb admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:35.981176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50ac1-d659-4d3c-846c-c6c6f37fb516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:35.982121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50ac1-d659-4d3c-846c-c6c6f37fb516 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:35.982536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50ac1-d659-4d3c-846c-c6c6f37fb516 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:35.982901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae50ac1-d659-4d3c-846c-c6c6f37fb516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:35.989344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aae50ac1-d659-4d3c-846c-c6c6f37fb516 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:36.025793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 874/1734] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:36.027152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c312ebf-f38d-4cf0-9d38-69d7b17cce94 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:36.030289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50ac1-d659-4d3c-846c-c6c6f37fb516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:36.032493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae50ac1-d659-4d3c-846c-c6c6f37fb516 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:36.036367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9c312ebf-f38d-4cf0-9d38-69d7b17cce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:36.055972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 861/1735] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:36.057067 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50ac1-d659-4d3c-846c-c6c6f37fb516 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:36.059130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aae50ac1-d659-4d3c-846c-c6c6f37fb516 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:36.075819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c312ebf-f38d-4cf0-9d38-69d7b17cce94 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:36.094164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:36.096616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:36.097525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:36.098407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] PATH_INFO: `/v3/users/dc5d3dad764944cbb6201d6ac68b4cb1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:36.104095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc5d3dad764944cbb6201d6ac68b4cb1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:36.110538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:36.210196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae50ac1-d659-4d3c-846c-c6c6f37fb516 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:36.219774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22bfa2-594b-4ae5-8671-1b6c00ce9465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:36.223061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22bfa2-594b-4ae5-8671-1b6c00ce9465 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:36.227252 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22bfa2-594b-4ae5-8671-1b6c00ce9465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:36.227679 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22bfa2-594b-4ae5-8671-1b6c00ce9465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:36.250191 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22bfa2-594b-4ae5-8671-1b6c00ce9465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:36.252431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22bfa2-594b-4ae5-8671-1b6c00ce9465 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:36.284335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 862/1736] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:36.430287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc5d3dad764944cbb6201d6ac68b4cb1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:36.431324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc5d3dad764944cbb6201d6ac68b4cb1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:36.496204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc5d3dad764944cbb6201d6ac68b4cb1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:36.496835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc5d3dad764944cbb6201d6ac68b4cb1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:36.511847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc5d3dad764944cbb6201d6ac68b4cb1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:36.541383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 875/1737] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:36 2022] DELETE /identity/v3/users/dc5d3dad764944cbb6201d6ac68b4cb1 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:36.547792 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc14e5-32f5-4bb0-b08c-7210c0aec1a7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:36.548978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc14e5-32f5-4bb0-b08c-7210c0aec1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:36.549889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc14e5-32f5-4bb0-b08c-7210c0aec1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:36.580799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2dcc14e5-32f5-4bb0-b08c-7210c0aec1a7 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:36.582607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2dcc14e5-32f5-4bb0-b08c-7210c0aec1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:36.740020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 863/1738] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:36.748892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:36.752178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:36.844205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c581b9-a1e0-4cff-a90f-6bfcee53981a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:36.848920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63a594-ff45-432d-99a1-6943d7f04e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:36.849736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a594-ff45-432d-99a1-6943d7f04e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:36.850029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a594-ff45-432d-99a1-6943d7f04e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:36.850685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63a594-ff45-432d-99a1-6943d7f04e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:36.861795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63a594-ff45-432d-99a1-6943d7f04e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:36.863310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63a594-ff45-432d-99a1-6943d7f04e14 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:36.874109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 876/1739] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:36.957713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc14e5-32f5-4bb0-b08c-7210c0aec1a7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:36.967069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2dcc14e5-32f5-4bb0-b08c-7210c0aec1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:36.975239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc14e5-32f5-4bb0-b08c-7210c0aec1a7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:36.988824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:36.990770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:36.990770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:36.990770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] PATH_INFO: `/v3/projects/0a9284dd8c1c498b8620b8bef3c2b368` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:36.995500 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9284dd8c1c498b8620b8bef3c2b368)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:36.997517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:37.113857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:37.169265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9284dd8c1c498b8620b8bef3c2b368', 'request_id': 'req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.174707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9284dd8c1c498b8620b8bef3c2b368', 'request_id': 'req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.181563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9284dd8c1c498b8620b8bef3c2b368', 'request_id': 'req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.280132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] The token cache is being invalidate because project 0a9284dd8c1c498b8620b8bef3c2b368 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:37.280438 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.281106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.282727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 864/1740] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:36 2022] DELETE /identity/v3/projects/0a9284dd8c1c498b8620b8bef3c2b368 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:37.286656 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63a594-ff45-432d-99a1-6943d7f04e14 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:37.296876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63a594-ff45-432d-99a1-6943d7f04e14 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:37.354751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:37.355640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:37.356061 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:37.356343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] PATH_INFO: `/v3/users/401b484e0ea347aba9426d911e4989ff` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:37.357603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=401b484e0ea347aba9426d911e4989ff)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:37.359685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:37.390369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:37.391893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:37.415134 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af7607-e5c9-4bc6-b06e-6d81b0f98e47 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:37.423152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:37.425102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:37.425601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:37.426043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] PATH_INFO: `/v3/projects/9bdf4fbfe8ef41a6899fac86c555beff` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:37.427811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bdf4fbfe8ef41a6899fac86c555beff)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:37.431175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:37.576405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bdf4fbfe8ef41a6899fac86c555beff', 'request_id': 'req-914c1f4f-9a92-4434-97ab-b314030ab70f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.580962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '401b484e0ea347aba9426d911e4989ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.582220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '401b484e0ea347aba9426d911e4989ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.587782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bdf4fbfe8ef41a6899fac86c555beff', 'request_id': 'req-914c1f4f-9a92-4434-97ab-b314030ab70f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.600974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bdf4fbfe8ef41a6899fac86c555beff', 'request_id': 'req-914c1f4f-9a92-4434-97ab-b314030ab70f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.660491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '401b484e0ea347aba9426d911e4989ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.661237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '401b484e0ea347aba9426d911e4989ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.677768 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '401b484e0ea347aba9426d911e4989ff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.691714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 877/1741] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:37 2022] DELETE /identity/v3/users/401b484e0ea347aba9426d911e4989ff => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:37.742370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] The token cache is being invalidate because project 9bdf4fbfe8ef41a6899fac86c555beff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:37.742669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.744647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:37.745455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 865/1742] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:37 2022] DELETE /identity/v3/projects/9bdf4fbfe8ef41a6899fac86c555beff => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:37.749610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:37.751338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:37.824577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe6d73a-f008-4779-b29e-19df8b41da14 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:37.829360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:37.830402 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:37.830597 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:37.830875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] PATH_INFO: `/v3/users/09cc55996e094238ac63a6354d6738eb` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:37.832083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09cc55996e094238ac63a6354d6738eb)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:37.834053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:38.118129 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09cc55996e094238ac63a6354d6738eb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:38.118801 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09cc55996e094238ac63a6354d6738eb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:38.290735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09cc55996e094238ac63a6354d6738eb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:38.291353 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09cc55996e094238ac63a6354d6738eb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:38.297982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:38.299585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:38.309887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-0645bc0c-abb2-4b79-8ac0-52d1b5cd9604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09cc55996e094238ac63a6354d6738eb'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:38.324032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 878/1743] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:37 2022] DELETE /identity/v3/users/09cc55996e094238ac63a6354d6738eb => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:38.372286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c1f4f-9a92-4434-97ab-b314030ab70f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:38.410679 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:38.433461 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:38.434366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:38.434654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:38.434937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] PATH_INFO: `/v3/projects/2170b73ca44b4400aad5e98350c0b317` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:38.436148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2170b73ca44b4400aad5e98350c0b317)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:38.438130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:38.550057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2170b73ca44b4400aad5e98350c0b317', 'request_id': 'req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:38.556865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2170b73ca44b4400aad5e98350c0b317', 'request_id': 'req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:38.563192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2170b73ca44b4400aad5e98350c0b317', 'request_id': 'req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:38.690401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] The token cache is being invalidate because project 2170b73ca44b4400aad5e98350c0b317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:38.691384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:38.692091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:38.694006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 866/1744] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:38 2022] DELETE /identity/v3/projects/2170b73ca44b4400aad5e98350c0b317 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:38.699111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d76d6-b196-4ad7-b2fe-0802211475b8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:38.699602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d76d6-b196-4ad7-b2fe-0802211475b8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:38.699903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d76d6-b196-4ad7-b2fe-0802211475b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:38.723914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7a8d76d6-b196-4ad7-b2fe-0802211475b8 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:38.725366 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7a8d76d6-b196-4ad7-b2fe-0802211475b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:38.801178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:38.802695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:38.875811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 879/1745] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:38.885022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aaeb1-4298-48df-9c46-d9afbd000976 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:38.885553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aaeb1-4298-48df-9c46-d9afbd000976 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:38.885887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aaeb1-4298-48df-9c46-d9afbd000976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:38.929100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-172aaeb1-4298-48df-9c46-d9afbd000976 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:38.934736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-172aaeb1-4298-48df-9c46-d9afbd000976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:38.949106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 880/1746] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:38.953511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aaeb1-4298-48df-9c46-d9afbd000976 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:38.962366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b3fd8-fdb8-47b5-99d0-e27dcd5de291 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:38.964527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aaeb1-4298-48df-9c46-d9afbd000976 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:38.968654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:38.968789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:38.969161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:38.969588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] PATH_INFO: `/v3/projects/807ef2472d9b46b08737b8877e368175` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:38.969849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb0512-d142-4e2d-b27a-2b665ca6586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:38.970497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb0512-d142-4e2d-b27a-2b665ca6586b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:38.970959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb0512-d142-4e2d-b27a-2b665ca6586b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:38.971061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] RBAC: Authorizing `identity:delete_project(project_id=807ef2472d9b46b08737b8877e368175)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:38.971273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb0512-d142-4e2d-b27a-2b665ca6586b admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:38.972246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb0512-d142-4e2d-b27a-2b665ca6586b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:38.972748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb0512-d142-4e2d-b27a-2b665ca6586b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:38.973256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:38.974692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb0512-d142-4e2d-b27a-2b665ca6586b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:38.991033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 881/1747] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:46:38.996566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb0512-d142-4e2d-b27a-2b665ca6586b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:39.019205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb0512-d142-4e2d-b27a-2b665ca6586b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:39.035341 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf299a-4b38-467e-8199-6fffbda06dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:39.043459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf299a-4b38-467e-8199-6fffbda06dfa admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:39.043459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf299a-4b38-467e-8199-6fffbda06dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:39.043459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf299a-4b38-467e-8199-6fffbda06dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:39.043459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf299a-4b38-467e-8199-6fffbda06dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:39.043459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbf299a-4b38-467e-8199-6fffbda06dfa admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:39.139246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807ef2472d9b46b08737b8877e368175', 'request_id': 'req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:39.149793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807ef2472d9b46b08737b8877e368175', 'request_id': 'req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:39.162118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807ef2472d9b46b08737b8877e368175', 'request_id': 'req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:39.187057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 882/1748] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:38 2022] POST /identity/v3/projects => generated 391 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:39.188610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf299a-4b38-467e-8199-6fffbda06dfa admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:39.266382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf299a-4b38-467e-8199-6fffbda06dfa admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:39.271385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ab6c6-693c-4690-8937-fbaea2fc623f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:39.272092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ab6c6-693c-4690-8937-fbaea2fc623f admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:39.272378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ab6c6-693c-4690-8937-fbaea2fc623f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:39.272654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ab6c6-693c-4690-8937-fbaea2fc623f admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:39.273901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ab6c6-693c-4690-8937-fbaea2fc623f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:39.275863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ab6c6-693c-4690-8937-fbaea2fc623f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:39.313616 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] The token cache is being invalidate because project 807ef2472d9b46b08737b8877e368175 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:39.314028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:39.314712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-aa4d5143-5c86-4f13-a1ad-75c26d92a35a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:39.316413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 867/1749] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:38 2022] DELETE /identity/v3/projects/807ef2472d9b46b08737b8877e368175 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:39.321365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894ea1d-9af8-4109-b59a-91a5d0f24a44 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:39.321955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894ea1d-9af8-4109-b59a-91a5d0f24a44 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:39.322242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894ea1d-9af8-4109-b59a-91a5d0f24a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:39.342393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4894ea1d-9af8-4109-b59a-91a5d0f24a44 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:39.343987 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4894ea1d-9af8-4109-b59a-91a5d0f24a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:39.354116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 868/1750] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:39.363762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854e05-ae1e-4f43-bbcb-c8c722e35ed0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:39.364168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854e05-ae1e-4f43-bbcb-c8c722e35ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:39.364610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30854e05-ae1e-4f43-bbcb-c8c722e35ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:39.388833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-30854e05-ae1e-4f43-bbcb-c8c722e35ed0 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:39.390204 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-30854e05-ae1e-4f43-bbcb-c8c722e35ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:39.409037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 883/1751] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:39 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:46:39.412627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 869/1752] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:39.413318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ab6c6-693c-4690-8937-fbaea2fc623f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:39.417272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c75ab6c6-693c-4690-8937-fbaea2fc623f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:39.421971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30854e05-ae1e-4f43-bbcb-c8c722e35ed0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:39.432043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ab6c6-693c-4690-8937-fbaea2fc623f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:39.433476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30854e05-ae1e-4f43-bbcb-c8c722e35ed0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:39.437859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bde15-8bd7-4096-afe1-9dd424fb2e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:39.438817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bde15-8bd7-4096-afe1-9dd424fb2e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:39.439179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bde15-8bd7-4096-afe1-9dd424fb2e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:39.439531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bde15-8bd7-4096-afe1-9dd424fb2e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:39.439629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58dd5-c33e-439b-aee9-b30af8c2ce9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:39.440465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bde15-8bd7-4096-afe1-9dd424fb2e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:39.440629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58dd5-c33e-439b-aee9-b30af8c2ce9e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:39.440832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58dd5-c33e-439b-aee9-b30af8c2ce9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:39.441178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c58dd5-c33e-439b-aee9-b30af8c2ce9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:39.442021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40bde15-8bd7-4096-afe1-9dd424fb2e02 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:39.449960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58dd5-c33e-439b-aee9-b30af8c2ce9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:39.449960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58dd5-c33e-439b-aee9-b30af8c2ce9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:39.449960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c58dd5-c33e-439b-aee9-b30af8c2ce9e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:39.460495 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 884/1753] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:39.467386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bde15-8bd7-4096-afe1-9dd424fb2e02 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:39.468348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 870/1754] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:46:39.478934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58dd5-c33e-439b-aee9-b30af8c2ce9e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:39.481205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bde15-8bd7-4096-afe1-9dd424fb2e02 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:39.492540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67bc41-07de-442b-ace2-ce606a7e6d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:39.493434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67bc41-07de-442b-ace2-ce606a7e6d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:39.493756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67bc41-07de-442b-ace2-ce606a7e6d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:39.494115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc67bc41-07de-442b-ace2-ce606a7e6d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:39.497493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c58dd5-c33e-439b-aee9-b30af8c2ce9e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:39.501864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67bc41-07de-442b-ace2-ce606a7e6d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:39.503721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b54765-8e87-4b04-b591-514a74f80e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:39.504533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b54765-8e87-4b04-b591-514a74f80e8f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:39.505047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc67bc41-07de-442b-ace2-ce606a7e6d6c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:39.521796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b54765-8e87-4b04-b591-514a74f80e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:39.521796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b54765-8e87-4b04-b591-514a74f80e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:39.521796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b54765-8e87-4b04-b591-514a74f80e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:39.521796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b54765-8e87-4b04-b591-514a74f80e8f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:39.525708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 885/1755] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:39.528260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67bc41-07de-442b-ace2-ce606a7e6d6c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:39.538228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc67bc41-07de-442b-ace2-ce606a7e6d6c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:39.543030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db02a1-5ad5-4165-b562-c713a98bded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:39.543941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db02a1-5ad5-4165-b562-c713a98bded8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:39.544227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db02a1-5ad5-4165-b562-c713a98bded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:39.544501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db02a1-5ad5-4165-b562-c713a98bded8 admin admin] PATH_INFO: `/v3/projects/9a01438422b84ec4aadd052bcb79e188/users/10871ea3318c4da9ac9ce7c711bfce8d/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:39.547586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:39.564400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db02a1-5ad5-4165-b562-c713a98bded8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a01438422b84ec4aadd052bcb79e188, user_id=10871ea3318c4da9ac9ce7c711bfce8d, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:39.567392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db02a1-5ad5-4165-b562-c713a98bded8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:39.894356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 886/1756] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:39 2022] PUT /identity/v3/projects/9a01438422b84ec4aadd052bcb79e188/users/10871ea3318c4da9ac9ce7c711bfce8d/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:39.952793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 871/1757] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:39 2022] POST /identity/v3/projects => generated 357 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:46:39.953867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db02a1-5ad5-4165-b562-c713a98bded8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:39.957611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecee8b5-3189-4616-823c-95e52120dc30 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:39.965939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecee8b5-3189-4616-823c-95e52120dc30 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:39.965939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecee8b5-3189-4616-823c-95e52120dc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:40.002996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-aecee8b5-3189-4616-823c-95e52120dc30 None None] MFA Rules not processed for user `10871ea3318c4da9ac9ce7c711bfce8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:40.014082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-aecee8b5-3189-4616-823c-95e52120dc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:40.115905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db02a1-5ad5-4165-b562-c713a98bded8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:40.153130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 872/1758] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:40.159106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecee8b5-3189-4616-823c-95e52120dc30 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:40.194204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b111-1d6f-40d4-bd89-faf306c0f3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:40.194906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b111-1d6f-40d4-bd89-faf306c0f3d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:40.195515 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b111-1d6f-40d4-bd89-faf306c0f3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:40.195803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964b111-1d6f-40d4-bd89-faf306c0f3d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:40.196510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964b111-1d6f-40d4-bd89-faf306c0f3d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:40.198522 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964b111-1d6f-40d4-bd89-faf306c0f3d6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:40.258915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecee8b5-3189-4616-823c-95e52120dc30 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:40.268216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44141148-1428-488c-abf3-de6f95644ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:40.268974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44141148-1428-488c-abf3-de6f95644ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:40.270529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44141148-1428-488c-abf3-de6f95644ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:40.270816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44141148-1428-488c-abf3-de6f95644ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:40.271686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44141148-1428-488c-abf3-de6f95644ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:40.282465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44141148-1428-488c-abf3-de6f95644ed4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:40.328904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 887/1759] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:39 2022] POST /identity/v3/users => generated 279 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:40.333962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b111-1d6f-40d4-bd89-faf306c0f3d6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:40.366382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964b111-1d6f-40d4-bd89-faf306c0f3d6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:40.397685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f893-9f79-414b-a289-11555f9c674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:40.399735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f893-9f79-414b-a289-11555f9c674e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:40.401311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f893-9f79-414b-a289-11555f9c674e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:40.402116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1f893-9f79-414b-a289-11555f9c674e admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:40.404161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1f893-9f79-414b-a289-11555f9c674e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:40.413353 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e1f893-9f79-414b-a289-11555f9c674e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:40.473140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 873/1760] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:40 2022] POST /identity/v3/projects => generated 393 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:40.481157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44141148-1428-488c-abf3-de6f95644ed4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:40.488374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-44141148-1428-488c-abf3-de6f95644ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:40.495062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 888/1761] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:40.496978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f893-9f79-414b-a289-11555f9c674e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:40.550139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1f893-9f79-414b-a289-11555f9c674e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:40.721059 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9227f84-6169-439c-ae4a-9a8230d05996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:40.723749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227f84-6169-439c-ae4a-9a8230d05996 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:40.725385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227f84-6169-439c-ae4a-9a8230d05996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:40.726787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9227f84-6169-439c-ae4a-9a8230d05996 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:40.728258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9227f84-6169-439c-ae4a-9a8230d05996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:40.732356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9227f84-6169-439c-ae4a-9a8230d05996 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:40.759213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44141148-1428-488c-abf3-de6f95644ed4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:40.768326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:40.770269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:40.771034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:40.771743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] PATH_INFO: `/v3/users/7097a6336a6943dbb30fc4d531adb9fb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:40.774357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7097a6336a6943dbb30fc4d531adb9fb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:40.778241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:40.892350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 889/1762] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:40 2022] POST /identity/v3/users => generated 303 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:40.892350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9227f84-6169-439c-ae4a-9a8230d05996 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:40.940690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9227f84-6169-439c-ae4a-9a8230d05996 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:40.946085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c8f99-edd3-4b2a-80e2-971140ad1c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:40.947217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c8f99-edd3-4b2a-80e2-971140ad1c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:40.947659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c8f99-edd3-4b2a-80e2-971140ad1c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:40.948093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c8f99-edd3-4b2a-80e2-971140ad1c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:40.948888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c8f99-edd3-4b2a-80e2-971140ad1c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:40.963627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c8f99-edd3-4b2a-80e2-971140ad1c9e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:40.998307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 890/1763] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:40.998307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c8f99-edd3-4b2a-80e2-971140ad1c9e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:41.005519 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7097a6336a6943dbb30fc4d531adb9fb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:41.010853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c8f99-edd3-4b2a-80e2-971140ad1c9e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:41.018063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a14a5c-bd21-4772-bb9a-9f48eb1bdd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:41.018941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14a5c-bd21-4772-bb9a-9f48eb1bdd20 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.019723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14a5c-bd21-4772-bb9a-9f48eb1bdd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.019723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a14a5c-bd21-4772-bb9a-9f48eb1bdd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.020166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a14a5c-bd21-4772-bb9a-9f48eb1bdd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:41.021911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a14a5c-bd21-4772-bb9a-9f48eb1bdd20 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:41.037867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 891/1764] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:41.037867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a14a5c-bd21-4772-bb9a-9f48eb1bdd20 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:41.046927 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a14a5c-bd21-4772-bb9a-9f48eb1bdd20 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:41.052766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7014b3ba-9a0d-4fbd-bcdc-82fe2bdd45ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:41.053744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014b3ba-9a0d-4fbd-bcdc-82fe2bdd45ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.054036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014b3ba-9a0d-4fbd-bcdc-82fe2bdd45ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.054361 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014b3ba-9a0d-4fbd-bcdc-82fe2bdd45ce admin admin] PATH_INFO: `/v3/projects/37481888b1954e2fbedbb44031f42c64/users/68108bf2a07a46158968d8dde39d43c3/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.085174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014b3ba-9a0d-4fbd-bcdc-82fe2bdd45ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=37481888b1954e2fbedbb44031f42c64, user_id=68108bf2a07a46158968d8dde39d43c3, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:41.089957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7014b3ba-9a0d-4fbd-bcdc-82fe2bdd45ce admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:41.192110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7097a6336a6943dbb30fc4d531adb9fb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:41.197280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7097a6336a6943dbb30fc4d531adb9fb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:41.197280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7097a6336a6943dbb30fc4d531adb9fb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:41.206170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7097a6336a6943dbb30fc4d531adb9fb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:41.221539 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 874/1765] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:40 2022] DELETE /identity/v3/users/7097a6336a6943dbb30fc4d531adb9fb => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:41.222430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:41.227955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 892/1766] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:41 2022] PUT /identity/v3/projects/37481888b1954e2fbedbb44031f42c64/users/68108bf2a07a46158968d8dde39d43c3/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:41.228085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:41.228171 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee43d6-dadd-4177-b2b6-86c3d73565de None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.228171 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee43d6-dadd-4177-b2b6-86c3d73565de None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.228171 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfee43d6-dadd-4177-b2b6-86c3d73565de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.247938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-bfee43d6-dadd-4177-b2b6-86c3d73565de None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:41.249177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bfee43d6-dadd-4177-b2b6-86c3d73565de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:41.306535 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9ca69-aab5-4466-a000-a302e0970407 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:41.313082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510ada-7239-4614-a29f-a85ac1cf150f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:41.314053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510ada-7239-4614-a29f-a85ac1cf150f admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.314309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510ada-7239-4614-a29f-a85ac1cf150f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.314605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5510ada-7239-4614-a29f-a85ac1cf150f admin admin] PATH_INFO: `/v3/projects/a97c88eedac8436992b590c18e97ee88/users/bf9b8ff5af1d44a49ab9ffd332ac25f8/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.332362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5510ada-7239-4614-a29f-a85ac1cf150f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97c88eedac8436992b590c18e97ee88, user_id=bf9b8ff5af1d44a49ab9ffd332ac25f8, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:41.335486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 893/1767] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:41.340539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017194c-f167-4845-a8d9-6dda60167edb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.340539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017194c-f167-4845-a8d9-6dda60167edb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.340539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017194c-f167-4845-a8d9-6dda60167edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.340937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5510ada-7239-4614-a29f-a85ac1cf150f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:41.371908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7017194c-f167-4845-a8d9-6dda60167edb None None] MFA Rules not processed for user `68108bf2a07a46158968d8dde39d43c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:41.374030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7017194c-f167-4845-a8d9-6dda60167edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:41.434375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:41.470453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 875/1768] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:41 2022] PUT /identity/v3/projects/a97c88eedac8436992b590c18e97ee88/users/bf9b8ff5af1d44a49ab9ffd332ac25f8/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:41.471898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510ada-7239-4614-a29f-a85ac1cf150f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:41.477883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c5510ada-7239-4614-a29f-a85ac1cf150f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:41.485292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 894/1769] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:41 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:41.489838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017194c-f167-4845-a8d9-6dda60167edb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:41.501721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017194c-f167-4845-a8d9-6dda60167edb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:41.561336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5510ada-7239-4614-a29f-a85ac1cf150f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:41.565649 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12cd16-a9a1-416b-970a-7479b6c44189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:41.566780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12cd16-a9a1-416b-970a-7479b6c44189 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.567066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12cd16-a9a1-416b-970a-7479b6c44189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.567437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d12cd16-a9a1-416b-970a-7479b6c44189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.593745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdcfb3-4501-4be7-bee1-5ee35527efae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:41.593745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdcfb3-4501-4be7-bee1-5ee35527efae admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.593745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdcfb3-4501-4be7-bee1-5ee35527efae admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.593745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdcfb3-4501-4be7-bee1-5ee35527efae admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.594434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdcfb3-4501-4be7-bee1-5ee35527efae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:41.595399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:41.596273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdcfb3-4501-4be7-bee1-5ee35527efae admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:41.626051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 895/1770] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:41.626051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdcfb3-4501-4be7-bee1-5ee35527efae admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:41.630293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b1bdcfb3-4501-4be7-bee1-5ee35527efae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:41.652730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdcfb3-4501-4be7-bee1-5ee35527efae admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:41.668594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b92183-9b07-4750-932e-7a97f308c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:41.669019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b92183-9b07-4750-932e-7a97f308c6c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.669317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b92183-9b07-4750-932e-7a97f308c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.669600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b92183-9b07-4750-932e-7a97f308c6c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.670710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b92183-9b07-4750-932e-7a97f308c6c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:41.672420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b92183-9b07-4750-932e-7a97f308c6c3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:41.722102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12cd16-a9a1-416b-970a-7479b6c44189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:41.724782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d12cd16-a9a1-416b-970a-7479b6c44189 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:41.755200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 876/1771] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:41.756282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12cd16-a9a1-416b-970a-7479b6c44189 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:41.769445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d12cd16-a9a1-416b-970a-7479b6c44189 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:41.776907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939c39a-17b5-4673-a67a-0f8b487802e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:41.779952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939c39a-17b5-4673-a67a-0f8b487802e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.779952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939c39a-17b5-4673-a67a-0f8b487802e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.779952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939c39a-17b5-4673-a67a-0f8b487802e6 admin admin] PATH_INFO: `/v3/projects/a97c88eedac8436992b590c18e97ee88/users/bf9b8ff5af1d44a49ab9ffd332ac25f8/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.780955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939c39a-17b5-4673-a67a-0f8b487802e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a97c88eedac8436992b590c18e97ee88, user_id=bf9b8ff5af1d44a49ab9ffd332ac25f8, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:41.783684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f939c39a-17b5-4673-a67a-0f8b487802e6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:41.796574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 877/1772] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:41 2022] PUT /identity/v3/projects/a97c88eedac8436992b590c18e97ee88/users/bf9b8ff5af1d44a49ab9ffd332ac25f8/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:41.809087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b131be-32f3-4083-bafe-c33e6a7ef1a3 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.809463 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b131be-32f3-4083-bafe-c33e6a7ef1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.809686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b131be-32f3-4083-bafe-c33e6a7ef1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.813519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 896/1773] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:41 2022] POST /identity/v3/projects => generated 357 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:41.818284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b92183-9b07-4750-932e-7a97f308c6c3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:41.842760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-36b131be-32f3-4083-bafe-c33e6a7ef1a3 None None] MFA Rules not processed for user `bf9b8ff5af1d44a49ab9ffd332ac25f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:41.844124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-36b131be-32f3-4083-bafe-c33e6a7ef1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:41.941119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 878/1774] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:41.961751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b92183-9b07-4750-932e-7a97f308c6c3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:41.967672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b131be-32f3-4083-bafe-c33e6a7ef1a3 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:41.969280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-36b131be-32f3-4083-bafe-c33e6a7ef1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:41.979431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb824e-b4a8-4929-8562-d511717c1630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:41.981618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb824e-b4a8-4929-8562-d511717c1630 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:41.981618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb824e-b4a8-4929-8562-d511717c1630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:41.981618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb824e-b4a8-4929-8562-d511717c1630 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:41.981618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb824e-b4a8-4929-8562-d511717c1630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:41.991566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb824e-b4a8-4929-8562-d511717c1630 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:42.131058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b131be-32f3-4083-bafe-c33e6a7ef1a3 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:42.135938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffac86c-fc8c-46ee-bd78-a9bf3f9e6122 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:42.136616 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffac86c-fc8c-46ee-bd78-a9bf3f9e6122 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:42.136909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffac86c-fc8c-46ee-bd78-a9bf3f9e6122 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:42.137195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffac86c-fc8c-46ee-bd78-a9bf3f9e6122 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:42.147803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffac86c-fc8c-46ee-bd78-a9bf3f9e6122 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:42.149299 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffac86c-fc8c-46ee-bd78-a9bf3f9e6122 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:42.160000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 879/1775] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:42.217018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffac86c-fc8c-46ee-bd78-a9bf3f9e6122 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:42.226125 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffac86c-fc8c-46ee-bd78-a9bf3f9e6122 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:42.229838 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334a3e8-19fb-4409-ab97-17fdcec53700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:42.230490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a3e8-19fb-4409-ab97-17fdcec53700 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:42.230778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a3e8-19fb-4409-ab97-17fdcec53700 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:42.231056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334a3e8-19fb-4409-ab97-17fdcec53700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:42.233051 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f334a3e8-19fb-4409-ab97-17fdcec53700 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:42.252582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 897/1776] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:41 2022] POST /identity/v3/users => generated 285 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:46:42.255694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb824e-b4a8-4929-8562-d511717c1630 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:42.279363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb824e-b4a8-4929-8562-d511717c1630 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:42.294159 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74fbc8-9df9-4cef-afc6-8400c2bc41f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:42.294980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74fbc8-9df9-4cef-afc6-8400c2bc41f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:42.295595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74fbc8-9df9-4cef-afc6-8400c2bc41f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:42.295895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74fbc8-9df9-4cef-afc6-8400c2bc41f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:42.296894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74fbc8-9df9-4cef-afc6-8400c2bc41f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:42.299117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74fbc8-9df9-4cef-afc6-8400c2bc41f9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:42.322144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 898/1777] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:46:42.322630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334a3e8-19fb-4409-ab97-17fdcec53700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:42.322630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334a3e8-19fb-4409-ab97-17fdcec53700 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:42.324191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74fbc8-9df9-4cef-afc6-8400c2bc41f9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:42.333983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 880/1778] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:42.335642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74fbc8-9df9-4cef-afc6-8400c2bc41f9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:42.343431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033fe17-1280-4de7-84f9-329da98e875b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:42.343431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033fe17-1280-4de7-84f9-329da98e875b admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:42.343431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033fe17-1280-4de7-84f9-329da98e875b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:42.343431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033fe17-1280-4de7-84f9-329da98e875b admin admin] PATH_INFO: `/v3/projects/dd79556bd065488480dbae0d91f93537/users/441d5c8aa9884239a122faa6c6da04e2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:42.359926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033fe17-1280-4de7-84f9-329da98e875b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd79556bd065488480dbae0d91f93537, user_id=441d5c8aa9884239a122faa6c6da04e2, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:42.362755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033fe17-1280-4de7-84f9-329da98e875b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:42.449736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 899/1779] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:42 2022] PUT /identity/v3/projects/dd79556bd065488480dbae0d91f93537/users/441d5c8aa9884239a122faa6c6da04e2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:42.452062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334a3e8-19fb-4409-ab97-17fdcec53700 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:42.468108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334a3e8-19fb-4409-ab97-17fdcec53700 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:42.529419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681af8-48e2-4cf5-83d0-50eea409cde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:42.530243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681af8-48e2-4cf5-83d0-50eea409cde0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:42.530530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681af8-48e2-4cf5-83d0-50eea409cde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:42.530806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43681af8-48e2-4cf5-83d0-50eea409cde0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:42.531558 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43681af8-48e2-4cf5-83d0-50eea409cde0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:42.533200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43681af8-48e2-4cf5-83d0-50eea409cde0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:42.544193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 881/1780] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:42.548688 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033fe17-1280-4de7-84f9-329da98e875b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:42.577490 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033fe17-1280-4de7-84f9-329da98e875b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:42.577490 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db22a1c-8ab9-49bc-b9d5-651959b654e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:42.577490 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22a1c-8ab9-49bc-b9d5-651959b654e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:42.577490 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22a1c-8ab9-49bc-b9d5-651959b654e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:42.578553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db22a1c-8ab9-49bc-b9d5-651959b654e3 admin admin] PATH_INFO: `/v3/projects/dd79556bd065488480dbae0d91f93537/users/441d5c8aa9884239a122faa6c6da04e2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:42.578668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681af8-48e2-4cf5-83d0-50eea409cde0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:42.582195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db22a1c-8ab9-49bc-b9d5-651959b654e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd79556bd065488480dbae0d91f93537, user_id=441d5c8aa9884239a122faa6c6da04e2, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:42.585180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db22a1c-8ab9-49bc-b9d5-651959b654e3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:42.587974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-43681af8-48e2-4cf5-83d0-50eea409cde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:42.603668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43681af8-48e2-4cf5-83d0-50eea409cde0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:42.605745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 900/1781] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:42 2022] PUT /identity/v3/projects/dd79556bd065488480dbae0d91f93537/users/441d5c8aa9884239a122faa6c6da04e2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:42.617119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94d530-0726-4379-b792-576f10aec40c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:42.617119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94d530-0726-4379-b792-576f10aec40c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:42.617289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94d530-0726-4379-b792-576f10aec40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:42.662554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:42.665395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2d94d530-0726-4379-b792-576f10aec40c None None] MFA Rules not processed for user `441d5c8aa9884239a122faa6c6da04e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:42.668548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2d94d530-0726-4379-b792-576f10aec40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:42.689479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:42.690473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:42.690758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:42.691036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] PATH_INFO: `/v3/projects/29c430d6cb8e4e02871d8beebadde414` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:42.692662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c430d6cb8e4e02871d8beebadde414)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:42.695607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:42.816186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 901/1782] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:42 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:42.834920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c430d6cb8e4e02871d8beebadde414', 'request_id': 'req-a68954a4-ffef-4bd7-b162-011a0f2004fe'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:42.856326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c430d6cb8e4e02871d8beebadde414', 'request_id': 'req-a68954a4-ffef-4bd7-b162-011a0f2004fe'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:42.856326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c430d6cb8e4e02871d8beebadde414', 'request_id': 'req-a68954a4-ffef-4bd7-b162-011a0f2004fe'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:42.914670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94d530-0726-4379-b792-576f10aec40c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:42.916167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2d94d530-0726-4379-b792-576f10aec40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:42.952190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] The token cache is being invalidate because project 29c430d6cb8e4e02871d8beebadde414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:42.952496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:42.953215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a68954a4-ffef-4bd7-b162-011a0f2004fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:42.954808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 882/1783] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:42 2022] DELETE /identity/v3/projects/29c430d6cb8e4e02871d8beebadde414 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:42.960630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773460c2-6f3e-40ef-bc05-6f927d5f5e68 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:42.960955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773460c2-6f3e-40ef-bc05-6f927d5f5e68 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:42.961241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773460c2-6f3e-40ef-bc05-6f927d5f5e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:42.980430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-773460c2-6f3e-40ef-bc05-6f927d5f5e68 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:42.981689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-773460c2-6f3e-40ef-bc05-6f927d5f5e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:42.991308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94d530-0726-4379-b792-576f10aec40c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:43.048266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e58312-871c-4ecf-aec3-de970b472362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:43.048936 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e58312-871c-4ecf-aec3-de970b472362 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:43.049227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e58312-871c-4ecf-aec3-de970b472362 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:43.049498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e58312-871c-4ecf-aec3-de970b472362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:43.051459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-48e58312-871c-4ecf-aec3-de970b472362 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:43.061858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 883/1784] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:43.071326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b610d8-05ab-4c0a-a1dc-ed751ace18a5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:43.071326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b610d8-05ab-4c0a-a1dc-ed751ace18a5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:43.071326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b610d8-05ab-4c0a-a1dc-ed751ace18a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:43.102666 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-24b610d8-05ab-4c0a-a1dc-ed751ace18a5 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:43.102666 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-24b610d8-05ab-4c0a-a1dc-ed751ace18a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:43.108273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 884/1785] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:43.113824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b610d8-05ab-4c0a-a1dc-ed751ace18a5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:43.124202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b610d8-05ab-4c0a-a1dc-ed751ace18a5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:43.132286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7d91-6444-43a7-b83e-70d574a47f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:43.133879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7d91-6444-43a7-b83e-70d574a47f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:43.134182 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7d91-6444-43a7-b83e-70d574a47f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:43.134491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eb7d91-6444-43a7-b83e-70d574a47f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:43.135231 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7d91-6444-43a7-b83e-70d574a47f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:43.136223 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7d91-6444-43a7-b83e-70d574a47f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:43.137463 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eb7d91-6444-43a7-b83e-70d574a47f78 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:43.138493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e58312-871c-4ecf-aec3-de970b472362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:43.140103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e58312-871c-4ecf-aec3-de970b472362 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:43.151774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 902/1786] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:42 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:43.155497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 885/1787] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:46:43.157073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e58312-871c-4ecf-aec3-de970b472362 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:43.169048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e58312-871c-4ecf-aec3-de970b472362 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:43.174609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192ee16-eb45-4e03-acd4-ad92879f6d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:43.175356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ee16-eb45-4e03-acd4-ad92879f6d40 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:43.175639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ee16-eb45-4e03-acd4-ad92879f6d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:43.175919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192ee16-eb45-4e03-acd4-ad92879f6d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:43.176622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192ee16-eb45-4e03-acd4-ad92879f6d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:43.178585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192ee16-eb45-4e03-acd4-ad92879f6d40 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:43.321514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 903/1788] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:43 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:43.323864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7d91-6444-43a7-b83e-70d574a47f78 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:43.335475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eb7d91-6444-43a7-b83e-70d574a47f78 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:43.400843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331a2d-f64b-4078-a67b-f66d3d074bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:43.401516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331a2d-f64b-4078-a67b-f66d3d074bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:43.401841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331a2d-f64b-4078-a67b-f66d3d074bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:43.402124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56331a2d-f64b-4078-a67b-f66d3d074bc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:43.402807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56331a2d-f64b-4078-a67b-f66d3d074bc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:43.404707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56331a2d-f64b-4078-a67b-f66d3d074bc6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:43.493604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192ee16-eb45-4e03-acd4-ad92879f6d40 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:43.495505 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3192ee16-eb45-4e03-acd4-ad92879f6d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:43.535119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 886/1789] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:43 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:43.540139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331a2d-f64b-4078-a67b-f66d3d074bc6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:43.554369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56331a2d-f64b-4078-a67b-f66d3d074bc6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:43.560780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929289-751d-443d-9869-26d4f5677b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:43.562589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929289-751d-443d-9869-26d4f5677b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:43.563047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929289-751d-443d-9869-26d4f5677b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:43.567426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f929289-751d-443d-9869-26d4f5677b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:43.567618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192ee16-eb45-4e03-acd4-ad92879f6d40 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:43.567743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f929289-751d-443d-9869-26d4f5677b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:43.567743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f929289-751d-443d-9869-26d4f5677b05 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:43.569288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfdc6c-8335-49ab-823a-3b36a10bb966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:43.570319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfdc6c-8335-49ab-823a-3b36a10bb966 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:43.570438 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfdc6c-8335-49ab-823a-3b36a10bb966 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:43.570825 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfdc6c-8335-49ab-823a-3b36a10bb966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:43.573337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0ddfdc6c-8335-49ab-823a-3b36a10bb966 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:43.581273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 887/1790] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:46:43.586614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929289-751d-443d-9869-26d4f5677b05 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:43.597599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f929289-751d-443d-9869-26d4f5677b05 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:43.603492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567744da-b3f1-4d0e-960b-d6a09e3399de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:43.604216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567744da-b3f1-4d0e-960b-d6a09e3399de admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:43.604602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567744da-b3f1-4d0e-960b-d6a09e3399de admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:43.604889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567744da-b3f1-4d0e-960b-d6a09e3399de admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:43.605845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567744da-b3f1-4d0e-960b-d6a09e3399de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:43.607527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567744da-b3f1-4d0e-960b-d6a09e3399de admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:43.619673 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 888/1791] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:43.623437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567744da-b3f1-4d0e-960b-d6a09e3399de admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:43.635900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567744da-b3f1-4d0e-960b-d6a09e3399de admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:43.642995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a1ca-7f2a-4fcc-9219-2ac4dec126e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:43.643913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a1ca-7f2a-4fcc-9219-2ac4dec126e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:43.644322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a1ca-7f2a-4fcc-9219-2ac4dec126e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:43.644700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a1ca-7f2a-4fcc-9219-2ac4dec126e6 admin admin] PATH_INFO: `/v3/projects/f8e2fd907fff45fc80f982a320960021/users/a2423bf75b9a4c14a0cf00dd4940f33a/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:43.661559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8a1ca-7f2a-4fcc-9219-2ac4dec126e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e2fd907fff45fc80f982a320960021, user_id=a2423bf75b9a4c14a0cf00dd4940f33a, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:43.661794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfdc6c-8335-49ab-823a-3b36a10bb966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:43.664490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8a1ca-7f2a-4fcc-9219-2ac4dec126e6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:43.664646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfdc6c-8335-49ab-823a-3b36a10bb966 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:43.681340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 904/1792] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:43 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:43.786414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 889/1793] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:43 2022] PUT /identity/v3/projects/f8e2fd907fff45fc80f982a320960021/users/a2423bf75b9a4c14a0cf00dd4940f33a/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:43.799944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17056ce0-c78d-433e-ab4f-5016240a2869 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:43.800245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17056ce0-c78d-433e-ab4f-5016240a2869 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:43.800530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17056ce0-c78d-433e-ab4f-5016240a2869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:43.837035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-17056ce0-c78d-433e-ab4f-5016240a2869 None None] MFA Rules not processed for user `a2423bf75b9a4c14a0cf00dd4940f33a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:43.838333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-17056ce0-c78d-433e-ab4f-5016240a2869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:43.904032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 905/1794] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:43.909076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a1ca-7f2a-4fcc-9219-2ac4dec126e6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:43.969404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:44.021323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a1ca-7f2a-4fcc-9219-2ac4dec126e6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:44.025955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284c78a-ed16-43f1-91b8-1afa37f843e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:44.027148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284c78a-ed16-43f1-91b8-1afa37f843e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:44.027148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284c78a-ed16-43f1-91b8-1afa37f843e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:44.037208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284c78a-ed16-43f1-91b8-1afa37f843e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:44.037208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284c78a-ed16-43f1-91b8-1afa37f843e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:44.037208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284c78a-ed16-43f1-91b8-1afa37f843e1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:44.245644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 890/1795] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:43 2022] POST /identity/v3/projects => generated 375 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:44.249647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17056ce0-c78d-433e-ab4f-5016240a2869 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:44.278563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17056ce0-c78d-433e-ab4f-5016240a2869 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:44.352708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27880902-b3ed-4708-9592-6e5e0286e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:44.353690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27880902-b3ed-4708-9592-6e5e0286e6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:44.358386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27880902-b3ed-4708-9592-6e5e0286e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:44.358386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27880902-b3ed-4708-9592-6e5e0286e6c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:44.358386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27880902-b3ed-4708-9592-6e5e0286e6c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:44.358386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27880902-b3ed-4708-9592-6e5e0286e6c2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:44.483455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 906/1796] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:44 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:44.490703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284c78a-ed16-43f1-91b8-1afa37f843e1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:44.512976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284c78a-ed16-43f1-91b8-1afa37f843e1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:44.532305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a889a2-2463-42d4-b7c9-fb194262f6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:44.533567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a889a2-2463-42d4-b7c9-fb194262f6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:44.534051 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a889a2-2463-42d4-b7c9-fb194262f6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:44.534509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a889a2-2463-42d4-b7c9-fb194262f6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:44.535417 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a889a2-2463-42d4-b7c9-fb194262f6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:44.537231 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a889a2-2463-42d4-b7c9-fb194262f6a5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:44.552222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 891/1797] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:44.554878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:44.556187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27880902-b3ed-4708-9592-6e5e0286e6c2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:44.566893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27880902-b3ed-4708-9592-6e5e0286e6c2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:44.581054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b810a1a-4ef1-4495-9ae4-3076294ce20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:44.582372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b810a1a-4ef1-4495-9ae4-3076294ce20f admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:44.586417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b810a1a-4ef1-4495-9ae4-3076294ce20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:44.586417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b810a1a-4ef1-4495-9ae4-3076294ce20f admin admin] PATH_INFO: `/v3/projects/415a93bddd294217b85b23937b7b947a/users/5c9848dfd87049f6b2007b116266c049/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:44.603429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b810a1a-4ef1-4495-9ae4-3076294ce20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=415a93bddd294217b85b23937b7b947a, user_id=5c9848dfd87049f6b2007b116266c049, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:44.606596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b810a1a-4ef1-4495-9ae4-3076294ce20f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:44.776128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 907/1798] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:44 2022] PUT /identity/v3/projects/415a93bddd294217b85b23937b7b947a/users/5c9848dfd87049f6b2007b116266c049/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:44.777521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a889a2-2463-42d4-b7c9-fb194262f6a5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:44.798712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a889a2-2463-42d4-b7c9-fb194262f6a5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:44.874858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283b902-dacb-4e9f-973c-e22f10b35264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:44.875637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283b902-dacb-4e9f-973c-e22f10b35264 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:44.875989 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283b902-dacb-4e9f-973c-e22f10b35264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:44.876279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283b902-dacb-4e9f-973c-e22f10b35264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:44.877017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283b902-dacb-4e9f-973c-e22f10b35264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:44.878680 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283b902-dacb-4e9f-973c-e22f10b35264 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:44.903355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 892/1799] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:44.904680 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b810a1a-4ef1-4495-9ae4-3076294ce20f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:44.922816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b810a1a-4ef1-4495-9ae4-3076294ce20f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:44.928188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de5eef-5aaa-42ce-bc49-5bfea053106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:44.929130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5eef-5aaa-42ce-bc49-5bfea053106e admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:44.929430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5eef-5aaa-42ce-bc49-5bfea053106e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:44.929938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de5eef-5aaa-42ce-bc49-5bfea053106e admin admin] PATH_INFO: `/v3/projects/415a93bddd294217b85b23937b7b947a/users/5c9848dfd87049f6b2007b116266c049/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:44.932084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de5eef-5aaa-42ce-bc49-5bfea053106e admin admin] RBAC: Authorizing `identity:create_grant(project_id=415a93bddd294217b85b23937b7b947a, user_id=5c9848dfd87049f6b2007b116266c049, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:44.935289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de5eef-5aaa-42ce-bc49-5bfea053106e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:44.963641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 908/1800] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:44 2022] PUT /identity/v3/projects/415a93bddd294217b85b23937b7b947a/users/5c9848dfd87049f6b2007b116266c049/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:44.966653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a644a-edef-4a7b-b0b5-4b92a3cd11bd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:44.966955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a644a-edef-4a7b-b0b5-4b92a3cd11bd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:44.967308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a644a-edef-4a7b-b0b5-4b92a3cd11bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:45.040995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ca6a644a-edef-4a7b-b0b5-4b92a3cd11bd None None] MFA Rules not processed for user `5c9848dfd87049f6b2007b116266c049`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:45.042304 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ca6a644a-edef-4a7b-b0b5-4b92a3cd11bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:45.181727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 893/1801] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:45.200122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de5eef-5aaa-42ce-bc49-5bfea053106e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:45.330523 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de5eef-5aaa-42ce-bc49-5bfea053106e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:45.334499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a0347-0977-487b-80f5-1cf97d5908f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:45.335263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0347-0977-487b-80f5-1cf97d5908f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:45.335488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0347-0977-487b-80f5-1cf97d5908f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:45.336242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0347-0977-487b-80f5-1cf97d5908f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:45.346508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a0347-0977-487b-80f5-1cf97d5908f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:45.347984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a0347-0977-487b-80f5-1cf97d5908f3 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:45.361706 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 909/1802] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:46.574756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a644a-edef-4a7b-b0b5-4b92a3cd11bd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:46.574756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ca6a644a-edef-4a7b-b0b5-4b92a3cd11bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:46.702637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:46.772179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a644a-edef-4a7b-b0b5-4b92a3cd11bd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:46.781167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:46.786677 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:46.789330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:46.789651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] PATH_INFO: `/v3/users/d3202b452d1042c2ba44d632437d5d13` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:46.791274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3202b452d1042c2ba44d632437d5d13)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:46.793306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:46.986226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:47.063881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3202b452d1042c2ba44d632437d5d13'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:47.186551 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3202b452d1042c2ba44d632437d5d13'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:47.187884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3202b452d1042c2ba44d632437d5d13'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:47.188523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3202b452d1042c2ba44d632437d5d13'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:47.213244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3202b452d1042c2ba44d632437d5d13'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:47.231343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 894/1803] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:46 2022] DELETE /identity/v3/users/d3202b452d1042c2ba44d632437d5d13 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:47.236498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b2c3-987b-4b5f-a38b-0cbefb26de45 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:47.236785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b2c3-987b-4b5f-a38b-0cbefb26de45 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:47.237077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8b2c3-987b-4b5f-a38b-0cbefb26de45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:47.266442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-73d8b2c3-987b-4b5f-a38b-0cbefb26de45 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:47.267685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-73d8b2c3-987b-4b5f-a38b-0cbefb26de45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:47.332067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 910/1804] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:47.343145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:47.343145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:47.446780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a94d95-45ed-47a2-b7dc-2c4a72073da6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:47.451798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb411e39-56ff-4623-870e-b624b7fc4e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:47.452458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411e39-56ff-4623-870e-b624b7fc4e3c service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:47.452755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411e39-56ff-4623-870e-b624b7fc4e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:47.453034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb411e39-56ff-4623-870e-b624b7fc4e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:47.465220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb411e39-56ff-4623-870e-b624b7fc4e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:47.466710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb411e39-56ff-4623-870e-b624b7fc4e3c service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:47.480715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 895/1805] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:47.697013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b2c3-987b-4b5f-a38b-0cbefb26de45 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:47.698750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-73d8b2c3-987b-4b5f-a38b-0cbefb26de45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:47.859956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8b2c3-987b-4b5f-a38b-0cbefb26de45 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:47.868720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2af68-254c-4751-ac41-ea26bb0b2db9 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c9848dfd87049f6b2007b116266c049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '415a93bddd294217b85b23937b7b947a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:47.870547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2af68-254c-4751-ac41-ea26bb0b2db9 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:47.871075 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2af68-254c-4751-ac41-ea26bb0b2db9 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:47.871736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2af68-254c-4751-ac41-ea26bb0b2db9 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:47.873253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2af68-254c-4751-ac41-ea26bb0b2db9 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:47.873714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2af68-254c-4751-ac41-ea26bb0b2db9 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:47.876307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d2af68-254c-4751-ac41-ea26bb0b2db9 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:47.915064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 911/1806] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:46:47.916757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb411e39-56ff-4623-870e-b624b7fc4e3c service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:47.935425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb411e39-56ff-4623-870e-b624b7fc4e3c service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:47.945449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1a011-4b80-45f8-9cae-3440e5a6475e tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c9848dfd87049f6b2007b116266c049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '415a93bddd294217b85b23937b7b947a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:47.946233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a011-4b80-45f8-9cae-3440e5a6475e tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:47.946525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a011-4b80-45f8-9cae-3440e5a6475e tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:47.946811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a011-4b80-45f8-9cae-3440e5a6475e tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:47.949540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1a011-4b80-45f8-9cae-3440e5a6475e tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:47.956726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1a011-4b80-45f8-9cae-3440e5a6475e tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:48.171707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 896/1807] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:47 2022] POST /identity/v3/projects => generated 354 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:48.175690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2af68-254c-4751-ac41-ea26bb0b2db9 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:48.199753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2af68-254c-4751-ac41-ea26bb0b2db9 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:48.252063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1a011-4b80-45f8-9cae-3440e5a6475e tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:48.255886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-90f1a011-4b80-45f8-9cae-3440e5a6475e tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:48.331575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b3911-242a-4f3f-8c33-26e6d8816654 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c9848dfd87049f6b2007b116266c049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '415a93bddd294217b85b23937b7b947a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:48.332323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b3911-242a-4f3f-8c33-26e6d8816654 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:48.332775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b3911-242a-4f3f-8c33-26e6d8816654 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:48.333223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b3911-242a-4f3f-8c33-26e6d8816654 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:48.334505 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b3911-242a-4f3f-8c33-26e6d8816654 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:48.334819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b3911-242a-4f3f-8c33-26e6d8816654 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:48.337474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85b3911-242a-4f3f-8c33-26e6d8816654 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:48.356697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 912/1808] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:46:48.364143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1a011-4b80-45f8-9cae-3440e5a6475e tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:48.368532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:48.369630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:48.370034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:48.370383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] PATH_INFO: `/v3/projects/de42350ccb42418bbfee8541e161ba32` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:48.371668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de42350ccb42418bbfee8541e161ba32)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:48.374111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:48.407943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b3911-242a-4f3f-8c33-26e6d8816654 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:48.423462 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b3911-242a-4f3f-8c33-26e6d8816654 tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:48.429121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c9848dfd87049f6b2007b116266c049', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '415a93bddd294217b85b23937b7b947a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:48.431077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:48.431612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:48.432118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] PATH_INFO: `/v3/projects/4bcd24a3f0b0487ebc0b73f40a294249` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:48.433724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4bcd24a3f0b0487ebc0b73f40a294249)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:48.436116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:48.554502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de42350ccb42418bbfee8541e161ba32', 'request_id': 'req-40ed1967-560e-4b50-abd0-b997b7ed0ab0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:48.560437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de42350ccb42418bbfee8541e161ba32', 'request_id': 'req-40ed1967-560e-4b50-abd0-b997b7ed0ab0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:48.569016 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de42350ccb42418bbfee8541e161ba32', 'request_id': 'req-40ed1967-560e-4b50-abd0-b997b7ed0ab0'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:48.618946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcd24a3f0b0487ebc0b73f40a294249', 'request_id': 'req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:48.634901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcd24a3f0b0487ebc0b73f40a294249', 'request_id': 'req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:48.652924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcd24a3f0b0487ebc0b73f40a294249', 'request_id': 'req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:48.694159 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] The token cache is being invalidate because project de42350ccb42418bbfee8541e161ba32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:48.694699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:48.696270 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:48.699297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 897/1809] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:48 2022] DELETE /identity/v3/projects/de42350ccb42418bbfee8541e161ba32 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:48.703298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:48.704689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:48.776749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed1967-560e-4b50-abd0-b997b7ed0ab0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:48.812298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] The token cache is being invalidate because project 4bcd24a3f0b0487ebc0b73f40a294249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:48.812663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:48.813530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:48.815280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 913/1810] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:48 2022] DELETE /identity/v3/projects/4bcd24a3f0b0487ebc0b73f40a294249 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:48.846218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:48.847136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:48.848388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:48.848388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] PATH_INFO: `/v3/users/6fd25abea6a943a48cd2a03939ffe3d7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:48.849457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd25abea6a943a48cd2a03939ffe3d7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:48.851996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:49.102044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd25abea6a943a48cd2a03939ffe3d7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:49.222257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd25abea6a943a48cd2a03939ffe3d7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:49.223541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd25abea6a943a48cd2a03939ffe3d7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:49.224416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd25abea6a943a48cd2a03939ffe3d7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:49.248541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd25abea6a943a48cd2a03939ffe3d7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:49.271861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 898/1811] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:48 2022] DELETE /identity/v3/users/6fd25abea6a943a48cd2a03939ffe3d7 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:49.688542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:49.691122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:49.712274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7288e8-711e-4d4e-bb3f-fb71fe2bb9ba tempest-VolumeQuotaClassesTest-1847834 tempest-VolumeQuotaClassesTest-1847834-project-admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:49.793753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:49.796769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:49.796769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:49.796769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] PATH_INFO: `/v3/users/a2423bf75b9a4c14a0cf00dd4940f33a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:49.796769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2423bf75b9a4c14a0cf00dd4940f33a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:49.799086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:49.956560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:49.958358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:50.003326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbb40c-3fbf-448c-a3d9-52bfa5d6273d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:50.010469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:50.011579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:50.012018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:50.012424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] PATH_INFO: `/v3/projects/610e6e128be849cabcd2ac1708fa827f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:50.013880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=610e6e128be849cabcd2ac1708fa827f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:50.016468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:50.068102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2423bf75b9a4c14a0cf00dd4940f33a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.069198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2423bf75b9a4c14a0cf00dd4940f33a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.213921 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2423bf75b9a4c14a0cf00dd4940f33a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.216166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2423bf75b9a4c14a0cf00dd4940f33a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.235503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-52607232-eed6-4426-bb85-2655a02ec4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2423bf75b9a4c14a0cf00dd4940f33a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.245889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610e6e128be849cabcd2ac1708fa827f', 'request_id': 'req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.250513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 914/1812] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:49 2022] DELETE /identity/v3/users/a2423bf75b9a4c14a0cf00dd4940f33a => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:50.253887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610e6e128be849cabcd2ac1708fa827f', 'request_id': 'req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.255034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0fbca-c0a4-44a1-88b9-3c732ece2395 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:50.255431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0fbca-c0a4-44a1-88b9-3c732ece2395 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:50.255903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0fbca-c0a4-44a1-88b9-3c732ece2395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:50.262766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610e6e128be849cabcd2ac1708fa827f', 'request_id': 'req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.276964 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4fa0fbca-c0a4-44a1-88b9-3c732ece2395 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:50.278939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4fa0fbca-c0a4-44a1-88b9-3c732ece2395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:50.371568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 915/1813] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:50.373421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0fbca-c0a4-44a1-88b9-3c732ece2395 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:50.384008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4fa0fbca-c0a4-44a1-88b9-3c732ece2395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:50.396974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0fbca-c0a4-44a1-88b9-3c732ece2395 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:50.419608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] The token cache is being invalidate because project 610e6e128be849cabcd2ac1708fa827f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:50.419608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.419608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.419608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 899/1814] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:49 2022] DELETE /identity/v3/projects/610e6e128be849cabcd2ac1708fa827f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:50.420083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:50.420083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:50.420083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:50.420083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] PATH_INFO: `/v3/users/10871ea3318c4da9ac9ce7c711bfce8d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:50.420494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10871ea3318c4da9ac9ce7c711bfce8d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:50.420494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:50.425314 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:50.443121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:50.539235 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf41b07-3cf8-4f94-b5a3-aaa633fecc56 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:50.634618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea74916-3c67-4a73-8b3d-59b7f9e530dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:50.635306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea74916-3c67-4a73-8b3d-59b7f9e530dc service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:50.636044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea74916-3c67-4a73-8b3d-59b7f9e530dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:50.636044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea74916-3c67-4a73-8b3d-59b7f9e530dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:50.638713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2ea74916-3c67-4a73-8b3d-59b7f9e530dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:50.656718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea74916-3c67-4a73-8b3d-59b7f9e530dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:50.658532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea74916-3c67-4a73-8b3d-59b7f9e530dc service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:50.672246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10871ea3318c4da9ac9ce7c711bfce8d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.672959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10871ea3318c4da9ac9ce7c711bfce8d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.679495 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 900/1815] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:50.683373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c093200-f6fb-4c25-82a3-21990a68dede None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:50.683971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c093200-f6fb-4c25-82a3-21990a68dede None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:50.686714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c093200-f6fb-4c25-82a3-21990a68dede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:50.753106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10871ea3318c4da9ac9ce7c711bfce8d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.754555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10871ea3318c4da9ac9ce7c711bfce8d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.782268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6c093200-f6fb-4c25-82a3-21990a68dede None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:50.783777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6c093200-f6fb-4c25-82a3-21990a68dede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:50.783935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-10b9652f-996a-49a6-b713-fa36423490a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10871ea3318c4da9ac9ce7c711bfce8d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:50.808240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 916/1816] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:50 2022] DELETE /identity/v3/users/10871ea3318c4da9ac9ce7c711bfce8d => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:50.812089 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 901/1817] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:50.813908 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b998dbf-bd59-4d9a-9f1d-1ac52f4edca5 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:50.814196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b998dbf-bd59-4d9a-9f1d-1ac52f4edca5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:50.814476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b998dbf-bd59-4d9a-9f1d-1ac52f4edca5 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:50.815071 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd927-e959-4a80-a78e-e97390a5460d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:50.815536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd927-e959-4a80-a78e-e97390a5460d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:50.815951 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 902/1818] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:46:50.816355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebd927-e959-4a80-a78e-e97390a5460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:50.816951 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9d3d-d9f8-4e67-8a47-a0f17dfea9db None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:50.817236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9d3d-d9f8-4e67-8a47-a0f17dfea9db None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:50.817516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c9d3d-d9f8-4e67-8a47-a0f17dfea9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:50.843138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a9ebd927-e959-4a80-a78e-e97390a5460d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:50.844939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a9ebd927-e959-4a80-a78e-e97390a5460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:50.886412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3d9c9d3d-d9f8-4e67-8a47-a0f17dfea9db None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:50.887670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3d9c9d3d-d9f8-4e67-8a47-a0f17dfea9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:50.927620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 917/1819] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:50.960597 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc66e1-75b9-4f90-b264-aa61c5bbff35 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:50.961845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc66e1-75b9-4f90-b264-aa61c5bbff35 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:50.962299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc66e1-75b9-4f90-b264-aa61c5bbff35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:51.006738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 903/1820] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:51.007893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9d3d-d9f8-4e67-8a47-a0f17dfea9db None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:51.011948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3d9c9d3d-d9f8-4e67-8a47-a0f17dfea9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:51.015817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-abbc66e1-75b9-4f90-b264-aa61c5bbff35 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:51.015817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-abbc66e1-75b9-4f90-b264-aa61c5bbff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:51.102199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c9d3d-d9f8-4e67-8a47-a0f17dfea9db None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:51.106298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8282a4-2e03-41ab-ae0d-953e175128e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:51.107043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8282a4-2e03-41ab-ae0d-953e175128e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:51.107401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8282a4-2e03-41ab-ae0d-953e175128e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:51.107760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8282a4-2e03-41ab-ae0d-953e175128e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:51.114262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:51.122582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8282a4-2e03-41ab-ae0d-953e175128e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:51.132482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8282a4-2e03-41ab-ae0d-953e175128e1 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:51.134815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 904/1821] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:51.135650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8282a4-2e03-41ab-ae0d-953e175128e1 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:51.145417 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8282a4-2e03-41ab-ae0d-953e175128e1 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:51.150909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d26a58-3db7-45dc-b611-f6544bd23a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:51.155045 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 918/1822] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:46:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:51.165585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d26a58-3db7-45dc-b611-f6544bd23a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:51.166081 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d26a58-3db7-45dc-b611-f6544bd23a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:51.166377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d26a58-3db7-45dc-b611-f6544bd23a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:51.167248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d26a58-3db7-45dc-b611-f6544bd23a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:51.167575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d26a58-3db7-45dc-b611-f6544bd23a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:51.169228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d26a58-3db7-45dc-b611-f6544bd23a9f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:51.172224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc66e1-75b9-4f90-b264-aa61c5bbff35 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:51.173728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-abbc66e1-75b9-4f90-b264-aa61c5bbff35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:51.184730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 905/1823] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:46:51.190857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d26a58-3db7-45dc-b611-f6544bd23a9f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:51.199914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc66e1-75b9-4f90-b264-aa61c5bbff35 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:51.202720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d26a58-3db7-45dc-b611-f6544bd23a9f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:51.209061 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11d18d-921c-4d24-8e82-b654dc5d70b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:51.212638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11d18d-921c-4d24-8e82-b654dc5d70b8 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:51.212638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11d18d-921c-4d24-8e82-b654dc5d70b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:51.212638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11d18d-921c-4d24-8e82-b654dc5d70b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:51.215157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19498aab-4205-48a6-b59f-8bef70a20f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:51.217127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19498aab-4205-48a6-b59f-8bef70a20f1e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:51.217127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19498aab-4205-48a6-b59f-8bef70a20f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:51.217127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19498aab-4205-48a6-b59f-8bef70a20f1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:51.222502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19498aab-4205-48a6-b59f-8bef70a20f1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:51.223269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11d18d-921c-4d24-8e82-b654dc5d70b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:51.225685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11d18d-921c-4d24-8e82-b654dc5d70b8 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:51.227219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19498aab-4205-48a6-b59f-8bef70a20f1e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:51.240636 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 919/1824] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:51.373699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 906/1825] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:51 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:46:51.376811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11d18d-921c-4d24-8e82-b654dc5d70b8 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:51.388982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11d18d-921c-4d24-8e82-b654dc5d70b8 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:51.500532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1373c63-cfce-4534-ae8d-855515cf1de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:51.503320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373c63-cfce-4534-ae8d-855515cf1de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:51.505978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373c63-cfce-4534-ae8d-855515cf1de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:51.506550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1373c63-cfce-4534-ae8d-855515cf1de9 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:51.507576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1373c63-cfce-4534-ae8d-855515cf1de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:51.515381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1373c63-cfce-4534-ae8d-855515cf1de9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:51.535523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19498aab-4205-48a6-b59f-8bef70a20f1e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:51.538409 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-19498aab-4205-48a6-b59f-8bef70a20f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:51.576175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:51.584536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19498aab-4205-48a6-b59f-8bef70a20f1e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:51.596290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:51.599371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:51.599972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:51.600788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] PATH_INFO: `/v3/projects/f8e2fd907fff45fc80f982a320960021` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:51.603352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e2fd907fff45fc80f982a320960021)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:51.607560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:51.643540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 920/1826] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:51 2022] POST /identity/v3/users => generated 283 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:51.643540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1373c63-cfce-4534-ae8d-855515cf1de9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:51.688803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1373c63-cfce-4534-ae8d-855515cf1de9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:51.703718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c48f7-495c-4d6f-b32e-e4136a050cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:51.704954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c48f7-495c-4d6f-b32e-e4136a050cdc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:51.705635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c48f7-495c-4d6f-b32e-e4136a050cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:51.706588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c48f7-495c-4d6f-b32e-e4136a050cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:51.709925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c48f7-495c-4d6f-b32e-e4136a050cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:51.714748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c48f7-495c-4d6f-b32e-e4136a050cdc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:51.734950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 921/1827] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:51.738812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c48f7-495c-4d6f-b32e-e4136a050cdc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:51.749684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c48f7-495c-4d6f-b32e-e4136a050cdc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:51.754990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa735e-3115-418f-a8d3-ab21627ea76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:51.755710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa735e-3115-418f-a8d3-ab21627ea76a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:51.756202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa735e-3115-418f-a8d3-ab21627ea76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:51.756489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa735e-3115-418f-a8d3-ab21627ea76a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:51.757442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa735e-3115-418f-a8d3-ab21627ea76a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:51.761183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa735e-3115-418f-a8d3-ab21627ea76a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:51.774690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 922/1828] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:46:51.778469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa735e-3115-418f-a8d3-ab21627ea76a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:51.794951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa735e-3115-418f-a8d3-ab21627ea76a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:51.795532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e2fd907fff45fc80f982a320960021', 'request_id': 'req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:51.802301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e2fd907fff45fc80f982a320960021', 'request_id': 'req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:51.810300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e2fd907fff45fc80f982a320960021', 'request_id': 'req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:51.892403 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619087a-d459-4326-9631-1328f18f0c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:51.893329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619087a-d459-4326-9631-1328f18f0c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:51.893618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619087a-d459-4326-9631-1328f18f0c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:51.893935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619087a-d459-4326-9631-1328f18f0c16 admin admin] PATH_INFO: `/v3/projects/6e4a7dd7448845bb8586ee9a52f48e05/users/5b2c543cb41f4790a00cb15f1c49f03d/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:51.920009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619087a-d459-4326-9631-1328f18f0c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4a7dd7448845bb8586ee9a52f48e05, user_id=5b2c543cb41f4790a00cb15f1c49f03d, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:51.924020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f619087a-d459-4326-9631-1328f18f0c16 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:51.938000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] The token cache is being invalidate because project f8e2fd907fff45fc80f982a320960021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:51.938481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:51.939489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:51.947020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 907/1829] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:51 2022] DELETE /identity/v3/projects/f8e2fd907fff45fc80f982a320960021 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:51.956870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:51.958312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:51.979500 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd4b9b-1272-49e8-9aa8-05b085ec08f6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:51.988902 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:52.000547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:52.000547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:52.000547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] PATH_INFO: `/v3/users/5c9848dfd87049f6b2007b116266c049` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:52.000547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9848dfd87049f6b2007b116266c049)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:52.000547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:52.029764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 923/1830] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:51 2022] PUT /identity/v3/projects/6e4a7dd7448845bb8586ee9a52f48e05/users/5b2c543cb41f4790a00cb15f1c49f03d/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:52.041551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455e78e-e53c-4e4f-a979-026bcabec5db None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:52.042000 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455e78e-e53c-4e4f-a979-026bcabec5db None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:52.042140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455e78e-e53c-4e4f-a979-026bcabec5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:52.088062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9455e78e-e53c-4e4f-a979-026bcabec5db None None] MFA Rules not processed for user `5b2c543cb41f4790a00cb15f1c49f03d`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:52.090452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9455e78e-e53c-4e4f-a979-026bcabec5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:52.234236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 924/1831] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:52.236063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455e78e-e53c-4e4f-a979-026bcabec5db None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:52.237700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9455e78e-e53c-4e4f-a979-026bcabec5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:52.320649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455e78e-e53c-4e4f-a979-026bcabec5db None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:52.325422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9848dfd87049f6b2007b116266c049'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.327267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:52.328334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:52.328768 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:52.329205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] PATH_INFO: `/v3/projects/9a01438422b84ec4aadd052bcb79e188` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:52.331162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a01438422b84ec4aadd052bcb79e188)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:52.334723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:52.449949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9848dfd87049f6b2007b116266c049'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.450594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9848dfd87049f6b2007b116266c049'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.451241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9848dfd87049f6b2007b116266c049'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.465910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9848dfd87049f6b2007b116266c049'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.479351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 908/1832] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:51 2022] DELETE /identity/v3/users/5c9848dfd87049f6b2007b116266c049 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:52.480190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:52.481587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:52.484186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a01438422b84ec4aadd052bcb79e188', 'request_id': 'req-77991300-4d1c-4db6-9dde-d5c985b020b5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.491250 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a01438422b84ec4aadd052bcb79e188', 'request_id': 'req-77991300-4d1c-4db6-9dde-d5c985b020b5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.500001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a01438422b84ec4aadd052bcb79e188', 'request_id': 'req-77991300-4d1c-4db6-9dde-d5c985b020b5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.566086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dcfbd2-f39e-4322-97ab-2ce6931ee8a6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:52.578100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0da7-13da-495d-99ac-e6ebbe894238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:52.580567 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] The token cache is being invalidate because project 9a01438422b84ec4aadd052bcb79e188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:52.581058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.582458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0da7-13da-495d-99ac-e6ebbe894238 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:52.582948 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.584766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 925/1833] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:52 2022] DELETE /identity/v3/projects/9a01438422b84ec4aadd052bcb79e188 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:52.585329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0da7-13da-495d-99ac-e6ebbe894238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:52.586397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a0da7-13da-495d-99ac-e6ebbe894238 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:52.587288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a0da7-13da-495d-99ac-e6ebbe894238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:52.589259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a0da7-13da-495d-99ac-e6ebbe894238 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:52.590788 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:52.593181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:52.670489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77991300-4d1c-4db6-9dde-d5c985b020b5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:52.683910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:52.684815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:52.685099 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:52.685379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] PATH_INFO: `/v3/users/bf9b8ff5af1d44a49ab9ffd332ac25f8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:52.686723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf9b8ff5af1d44a49ab9ffd332ac25f8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:52.698941 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 909/1834] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:52 2022] POST /identity/v3/projects => generated 367 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:52.701131 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:52.702879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0da7-13da-495d-99ac-e6ebbe894238 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:52.719764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-206a0da7-13da-495d-99ac-e6ebbe894238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:52.858576 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a0da7-13da-495d-99ac-e6ebbe894238 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:52.863834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d02e3-6a99-45e6-96fb-63826fe7b062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:52.864522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d02e3-6a99-45e6-96fb-63826fe7b062 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:52.864838 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d02e3-6a99-45e6-96fb-63826fe7b062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:52.865113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d02e3-6a99-45e6-96fb-63826fe7b062 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:52.865869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d02e3-6a99-45e6-96fb-63826fe7b062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:52.867920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d02e3-6a99-45e6-96fb-63826fe7b062 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:52.967204 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 910/1835] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:52 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:52.972038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d02e3-6a99-45e6-96fb-63826fe7b062 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:52.972655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf9b8ff5af1d44a49ab9ffd332ac25f8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.974028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf9b8ff5af1d44a49ab9ffd332ac25f8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:52.987554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d02e3-6a99-45e6-96fb-63826fe7b062 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:52.990152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78034677-fd88-43ad-ad46-32759d1ae33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:52.991030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034677-fd88-43ad-ad46-32759d1ae33a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:52.991330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034677-fd88-43ad-ad46-32759d1ae33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:52.991611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034677-fd88-43ad-ad46-32759d1ae33a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:52.992408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78034677-fd88-43ad-ad46-32759d1ae33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:52.994105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78034677-fd88-43ad-ad46-32759d1ae33a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:53.005047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 911/1836] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:53.010256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78034677-fd88-43ad-ad46-32759d1ae33a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:53.012095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-78034677-fd88-43ad-ad46-32759d1ae33a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:53.028408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78034677-fd88-43ad-ad46-32759d1ae33a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:53.034953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6b77-3ebb-4175-8d4f-aae7f27b7479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:53.036540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6b77-3ebb-4175-8d4f-aae7f27b7479 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.037139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6b77-3ebb-4175-8d4f-aae7f27b7479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.038288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e6b77-3ebb-4175-8d4f-aae7f27b7479 admin admin] PATH_INFO: `/v3/projects/4fdc35e75ff34ad09e23f554a30b52fb/users/608c85e95763472687f85133147134b2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.057565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e6b77-3ebb-4175-8d4f-aae7f27b7479 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdc35e75ff34ad09e23f554a30b52fb, user_id=608c85e95763472687f85133147134b2, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:53.060329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e6b77-3ebb-4175-8d4f-aae7f27b7479 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:53.067786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf9b8ff5af1d44a49ab9ffd332ac25f8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:53.068233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf9b8ff5af1d44a49ab9ffd332ac25f8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:53.405148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf9b8ff5af1d44a49ab9ffd332ac25f8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:53.405148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 926/1837] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:46:52 2022] DELETE /identity/v3/users/bf9b8ff5af1d44a49ab9ffd332ac25f8 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:53.405148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:53.405148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:53.405148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b9e27-ce3c-4ed6-a666-8fe65037ce58 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:53.406295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:53.406295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.406295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.406295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] PATH_INFO: `/v3/projects/415a93bddd294217b85b23937b7b947a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.407093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] RBAC: Authorizing `identity:delete_project(project_id=415a93bddd294217b85b23937b7b947a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:53.407093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:53.444713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 912/1838] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:53 2022] PUT /identity/v3/projects/4fdc35e75ff34ad09e23f554a30b52fb/users/608c85e95763472687f85133147134b2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:53.449277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6b77-3ebb-4175-8d4f-aae7f27b7479 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:53.505285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415a93bddd294217b85b23937b7b947a', 'request_id': 'req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:53.515610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415a93bddd294217b85b23937b7b947a', 'request_id': 'req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:53.528073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415a93bddd294217b85b23937b7b947a', 'request_id': 'req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:53.549448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e6b77-3ebb-4175-8d4f-aae7f27b7479 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:53.636940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] The token cache is being invalidate because project 415a93bddd294217b85b23937b7b947a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:53.640851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:53.640851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-431ddf9e-42f0-4bae-a295-e2b6e5dcd80a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:53.640851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 927/1839] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:53 2022] DELETE /identity/v3/projects/415a93bddd294217b85b23937b7b947a => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:53.646216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90360aaf-43ee-43dc-8e56-9e42034bb991 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.646596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90360aaf-43ee-43dc-8e56-9e42034bb991 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.646796 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90360aaf-43ee-43dc-8e56-9e42034bb991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.671308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946b3fd-8c72-48fa-9e84-b1c93a568690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:53.671530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-90360aaf-43ee-43dc-8e56-9e42034bb991 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:53.672475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946b3fd-8c72-48fa-9e84-b1c93a568690 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.672667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-90360aaf-43ee-43dc-8e56-9e42034bb991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:53.672772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946b3fd-8c72-48fa-9e84-b1c93a568690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.673055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946b3fd-8c72-48fa-9e84-b1c93a568690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.673867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946b3fd-8c72-48fa-9e84-b1c93a568690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:53.676228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946b3fd-8c72-48fa-9e84-b1c93a568690 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:53.683793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 928/1840] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:53.693777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a658c-71dd-44a9-a17d-7377ac01dc4a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.698244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a658c-71dd-44a9-a17d-7377ac01dc4a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.698244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a658c-71dd-44a9-a17d-7377ac01dc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.698466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 913/1841] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:53.701356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946b3fd-8c72-48fa-9e84-b1c93a568690 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:53.703177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0946b3fd-8c72-48fa-9e84-b1c93a568690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:53.713794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-bc6a658c-71dd-44a9-a17d-7377ac01dc4a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:53.715040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bc6a658c-71dd-44a9-a17d-7377ac01dc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:53.716598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946b3fd-8c72-48fa-9e84-b1c93a568690 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:53.724678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c19b45-2dd8-46c9-9b4e-ba801f87d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:53.725921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c19b45-2dd8-46c9-9b4e-ba801f87d9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.726313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c19b45-2dd8-46c9-9b4e-ba801f87d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.727020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c19b45-2dd8-46c9-9b4e-ba801f87d9bd admin admin] PATH_INFO: `/v3/projects/4fdc35e75ff34ad09e23f554a30b52fb/users/608c85e95763472687f85133147134b2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.729154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c19b45-2dd8-46c9-9b4e-ba801f87d9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fdc35e75ff34ad09e23f554a30b52fb, user_id=608c85e95763472687f85133147134b2, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:53.734923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 929/1842] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:53.735153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c19b45-2dd8-46c9-9b4e-ba801f87d9bd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:53.736361 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a658c-71dd-44a9-a17d-7377ac01dc4a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:53.752588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a658c-71dd-44a9-a17d-7377ac01dc4a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:53.759053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17751674-1140-42bc-b32b-addb3ad25342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:53.760333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751674-1140-42bc-b32b-addb3ad25342 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.760705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751674-1140-42bc-b32b-addb3ad25342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.761049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17751674-1140-42bc-b32b-addb3ad25342 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.762546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751674-1140-42bc-b32b-addb3ad25342 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:53.763152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751674-1140-42bc-b32b-addb3ad25342 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:53.770044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 914/1843] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:53 2022] PUT /identity/v3/projects/4fdc35e75ff34ad09e23f554a30b52fb/users/608c85e95763472687f85133147134b2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:46:53.771617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c19b45-2dd8-46c9-9b4e-ba801f87d9bd admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:53.773321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17751674-1140-42bc-b32b-addb3ad25342 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:53.774323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-10c19b45-2dd8-46c9-9b4e-ba801f87d9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:53.795442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 930/1844] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:46:53.796870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9beb4-6a4f-4081-b5ed-3f4f9c1426f3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.797535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9beb4-6a4f-4081-b5ed-3f4f9c1426f3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.798327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9beb4-6a4f-4081-b5ed-3f4f9c1426f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.848964 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d1b9beb4-6a4f-4081-b5ed-3f4f9c1426f3 None None] MFA Rules not processed for user `608c85e95763472687f85133147134b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:53.852282 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d1b9beb4-6a4f-4081-b5ed-3f4f9c1426f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:53.894966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c19b45-2dd8-46c9-9b4e-ba801f87d9bd admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:53.904794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:53.904794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:53.905046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:53.905793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] PATH_INFO: `/v3/projects/a97c88eedac8436992b590c18e97ee88` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:53.908084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a97c88eedac8436992b590c18e97ee88)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:53.910734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:54.000256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 931/1845] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:54.000256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9beb4-6a4f-4081-b5ed-3f4f9c1426f3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:54.031064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9beb4-6a4f-4081-b5ed-3f4f9c1426f3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:54.046256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27bc1a-7068-4ee0-a616-980fc74d6d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:54.047444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27bc1a-7068-4ee0-a616-980fc74d6d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.047982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27bc1a-7068-4ee0-a616-980fc74d6d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.048443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27bc1a-7068-4ee0-a616-980fc74d6d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.049326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27bc1a-7068-4ee0-a616-980fc74d6d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:54.053508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27bc1a-7068-4ee0-a616-980fc74d6d4a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:54.074953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a97c88eedac8436992b590c18e97ee88', 'request_id': 'req-1aeaee77-758c-4c7d-b042-4b36ca6e257a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:54.083427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a97c88eedac8436992b590c18e97ee88', 'request_id': 'req-1aeaee77-758c-4c7d-b042-4b36ca6e257a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:54.093725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a97c88eedac8436992b590c18e97ee88', 'request_id': 'req-1aeaee77-758c-4c7d-b042-4b36ca6e257a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:54.226986 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] The token cache is being invalidate because project a97c88eedac8436992b590c18e97ee88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:46:54.227389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:54.228642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:46:54.229193 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 932/1846] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:53 2022] POST /identity/v3/projects => generated 409 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:54.230292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27bc1a-7068-4ee0-a616-980fc74d6d4a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:54.236982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 915/1847] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:46:53 2022] DELETE /identity/v3/projects/a97c88eedac8436992b590c18e97ee88 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:54.236982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:54.244728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0e27bc1a-7068-4ee0-a616-980fc74d6d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:54.251575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:54.336971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaee77-758c-4c7d-b042-4b36ca6e257a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:54.342667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27bc1a-7068-4ee0-a616-980fc74d6d4a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:54.348266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea64bec-ed46-46b0-9f95-f9780142e3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:54.349260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea64bec-ed46-46b0-9f95-f9780142e3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.350140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea64bec-ed46-46b0-9f95-f9780142e3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.351008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea64bec-ed46-46b0-9f95-f9780142e3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.353286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4ea64bec-ed46-46b0-9f95-f9780142e3f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:54.414994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45677414-bc01-43a6-b954-d9f96761efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:54.414994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45677414-bc01-43a6-b954-d9f96761efa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.414994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45677414-bc01-43a6-b954-d9f96761efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.415244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45677414-bc01-43a6-b954-d9f96761efa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.415950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45677414-bc01-43a6-b954-d9f96761efa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:54.418530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45677414-bc01-43a6-b954-d9f96761efa1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:54.451446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea64bec-ed46-46b0-9f95-f9780142e3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:54.452901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea64bec-ed46-46b0-9f95-f9780142e3f0 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:54.463923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 933/1848] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:54.465117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ffb3-9df4-4f77-8837-1130fead9983 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.465422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ffb3-9df4-4f77-8837-1130fead9983 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.465764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ffb3-9df4-4f77-8837-1130fead9983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.489216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f446ffb3-9df4-4f77-8837-1130fead9983 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:54.490487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f446ffb3-9df4-4f77-8837-1130fead9983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:54.506561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 916/1849] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:54 2022] POST /identity/v3/users => generated 305 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:54.506943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 934/1850] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:54.506943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27734343-d29d-4b61-b0d9-5f133f7984cc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.507149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27734343-d29d-4b61-b0d9-5f133f7984cc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.507435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27734343-d29d-4b61-b0d9-5f133f7984cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.512262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45677414-bc01-43a6-b954-d9f96761efa1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:54.528760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45677414-bc01-43a6-b954-d9f96761efa1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:54.529715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-27734343-d29d-4b61-b0d9-5f133f7984cc None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:54.530972 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-27734343-d29d-4b61-b0d9-5f133f7984cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:54.535144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42343a68-f534-4f5d-a6ee-981ac8573b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:54.536181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42343a68-f534-4f5d-a6ee-981ac8573b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.536691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42343a68-f534-4f5d-a6ee-981ac8573b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.536977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42343a68-f534-4f5d-a6ee-981ac8573b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.537753 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42343a68-f534-4f5d-a6ee-981ac8573b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:54.539851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42343a68-f534-4f5d-a6ee-981ac8573b96 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:54.545472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 935/1851] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:54.550859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27734343-d29d-4b61-b0d9-5f133f7984cc None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:54.556523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 917/1852] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:46:54.564312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42343a68-f534-4f5d-a6ee-981ac8573b96 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:54.564569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27734343-d29d-4b61-b0d9-5f133f7984cc None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:54.581211 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42343a68-f534-4f5d-a6ee-981ac8573b96 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:54.587875 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebea4c-d65b-4b50-96da-a4ec9b66da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:54.588679 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebea4c-d65b-4b50-96da-a4ec9b66da5f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.589035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebea4c-d65b-4b50-96da-a4ec9b66da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.589394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebea4c-d65b-4b50-96da-a4ec9b66da5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.590326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaae4a-e3e9-454f-8988-29347e994592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:54.590479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebea4c-d65b-4b50-96da-a4ec9b66da5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:54.592702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaae4a-e3e9-454f-8988-29347e994592 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.592874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebea4c-d65b-4b50-96da-a4ec9b66da5f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:54.593172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaae4a-e3e9-454f-8988-29347e994592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.595085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaae4a-e3e9-454f-8988-29347e994592 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.600544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeaae4a-e3e9-454f-8988-29347e994592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:46:54.601080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeaae4a-e3e9-454f-8988-29347e994592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:54.608795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeaae4a-e3e9-454f-8988-29347e994592 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:54.625166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 918/1853] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:54 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:54.626282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebea4c-d65b-4b50-96da-a4ec9b66da5f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:54.656734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebea4c-d65b-4b50-96da-a4ec9b66da5f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:54.664773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c68a39-8a7a-4877-bab8-de69e180a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:54.666468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c68a39-8a7a-4877-bab8-de69e180a974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.667079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c68a39-8a7a-4877-bab8-de69e180a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.667553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 936/1854] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:46:54.667805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c68a39-8a7a-4877-bab8-de69e180a974 admin admin] PATH_INFO: `/v3/projects/7d63b109e08e444d8e540340e2d1c65d/users/db726e2e19aa42c1b339b8dff90fa162/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.668437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaae4a-e3e9-454f-8988-29347e994592 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:54.697183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaae4a-e3e9-454f-8988-29347e994592 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:54.702548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:54.706015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca1f0f-db05-465e-af3a-ff35e146bd6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:54.707297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c68a39-8a7a-4877-bab8-de69e180a974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d63b109e08e444d8e540340e2d1c65d, user_id=db726e2e19aa42c1b339b8dff90fa162, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:54.711729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca1f0f-db05-465e-af3a-ff35e146bd6c service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.711729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca1f0f-db05-465e-af3a-ff35e146bd6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.711729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca1f0f-db05-465e-af3a-ff35e146bd6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.712594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c68a39-8a7a-4877-bab8-de69e180a974 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:54.718354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-09ca1f0f-db05-465e-af3a-ff35e146bd6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:54.796116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca1f0f-db05-465e-af3a-ff35e146bd6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:54.797583 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca1f0f-db05-465e-af3a-ff35e146bd6c service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:54.818045 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 937/1855] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:54.825150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca1f0f-db05-465e-af3a-ff35e146bd6c service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:54.827816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 919/1856] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:54 2022] PUT /identity/v3/projects/7d63b109e08e444d8e540340e2d1c65d/users/db726e2e19aa42c1b339b8dff90fa162/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:54.840548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb71208-8564-4235-919d-2b1adfe60757 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.842785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb71208-8564-4235-919d-2b1adfe60757 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.848208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb71208-8564-4235-919d-2b1adfe60757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.883354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca1f0f-db05-465e-af3a-ff35e146bd6c service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:54.914748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6bb71208-8564-4235-919d-2b1adfe60757 None None] MFA Rules not processed for user `db726e2e19aa42c1b339b8dff90fa162`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:54.917845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6bb71208-8564-4235-919d-2b1adfe60757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:54.952938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:54.984393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ccfbf-34e8-4f34-973e-6cdbebe66e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:54.984994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ccfbf-34e8-4f34-973e-6cdbebe66e8c admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:54.985273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ccfbf-34e8-4f34-973e-6cdbebe66e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:54.985555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881ccfbf-34e8-4f34-973e-6cdbebe66e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:54.986334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ccfbf-34e8-4f34-973e-6cdbebe66e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:54.989538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881ccfbf-34e8-4f34-973e-6cdbebe66e8c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:55.020966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 920/1857] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:54 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:55.026584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb71208-8564-4235-919d-2b1adfe60757 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:55.037902 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb71208-8564-4235-919d-2b1adfe60757 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:55.043260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31daec-531d-4503-a0eb-bc8fdee1c17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:55.043929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31daec-531d-4503-a0eb-bc8fdee1c17a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:55.044211 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31daec-531d-4503-a0eb-bc8fdee1c17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:55.044485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31daec-531d-4503-a0eb-bc8fdee1c17a admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:55.045188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31daec-531d-4503-a0eb-bc8fdee1c17a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:55.047110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31daec-531d-4503-a0eb-bc8fdee1c17a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:55.383246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 938/1858] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:54 2022] POST /identity/v3/projects => generated 387 bytes in 561 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:55.384934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ccfbf-34e8-4f34-973e-6cdbebe66e8c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:55.402594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 921/1859] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:55 2022] POST /identity/v3/projects => generated 407 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:46:55.403966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31daec-531d-4503-a0eb-bc8fdee1c17a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:55.491293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881ccfbf-34e8-4f34-973e-6cdbebe66e8c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:55.492023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31daec-531d-4503-a0eb-bc8fdee1c17a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:55.505345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dd9ae-3030-4a33-84a8-816b59a06410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:55.505689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe0273-ef95-4515-8166-e75a1321c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:55.505822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dd9ae-3030-4a33-84a8-816b59a06410 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:55.505822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dd9ae-3030-4a33-84a8-816b59a06410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:55.505822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58dd9ae-3030-4a33-84a8-816b59a06410 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:55.506061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe0273-ef95-4515-8166-e75a1321c4f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:55.506061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe0273-ef95-4515-8166-e75a1321c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:55.506061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe0273-ef95-4515-8166-e75a1321c4f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:55.506294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dd9ae-3030-4a33-84a8-816b59a06410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:55.506382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe0273-ef95-4515-8166-e75a1321c4f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:55.506382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe0273-ef95-4515-8166-e75a1321c4f9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:55.508170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58dd9ae-3030-4a33-84a8-816b59a06410 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:55.647377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 939/1860] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:55 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:55.647565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 922/1861] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:55 2022] POST /identity/v3/users => generated 310 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:55.648628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dd9ae-3030-4a33-84a8-816b59a06410 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:55.649061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe0273-ef95-4515-8166-e75a1321c4f9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:55.658931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58dd9ae-3030-4a33-84a8-816b59a06410 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:55.661360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe0273-ef95-4515-8166-e75a1321c4f9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:55.665748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d68c-e230-4ed4-94be-3d3257e82c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:55.666441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d68c-e230-4ed4-94be-3d3257e82c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:55.666726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d68c-e230-4ed4-94be-3d3257e82c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:55.667005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d68c-e230-4ed4-94be-3d3257e82c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:55.667597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785613b7-7c16-498c-a7c3-0223d1b4a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:55.668063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670d68c-e230-4ed4-94be-3d3257e82c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:55.668312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785613b7-7c16-498c-a7c3-0223d1b4a7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:55.668612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785613b7-7c16-498c-a7c3-0223d1b4a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:55.668945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785613b7-7c16-498c-a7c3-0223d1b4a7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:55.669352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670d68c-e230-4ed4-94be-3d3257e82c27 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:55.669916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785613b7-7c16-498c-a7c3-0223d1b4a7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:55.671599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785613b7-7c16-498c-a7c3-0223d1b4a7b1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:55.681983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 940/1862] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:46:55.685265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 923/1863] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:55.687023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d68c-e230-4ed4-94be-3d3257e82c27 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:55.687966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785613b7-7c16-498c-a7c3-0223d1b4a7b1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:55.698533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d68c-e230-4ed4-94be-3d3257e82c27 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:55.700625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785613b7-7c16-498c-a7c3-0223d1b4a7b1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:55.703626 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0383c3-6283-4b1d-8a3b-099101e099f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:55.704304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0383c3-6283-4b1d-8a3b-099101e099f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:55.704592 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0383c3-6283-4b1d-8a3b-099101e099f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:55.704950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0383c3-6283-4b1d-8a3b-099101e099f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:55.705612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0383c3-6283-4b1d-8a3b-099101e099f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:55.710377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53365dd5-cfff-4b13-ae75-0b8b1b4a4dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:55.710524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0383c3-6283-4b1d-8a3b-099101e099f6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:55.710608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53365dd5-cfff-4b13-ae75-0b8b1b4a4dde admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:55.710608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53365dd5-cfff-4b13-ae75-0b8b1b4a4dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:55.710608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53365dd5-cfff-4b13-ae75-0b8b1b4a4dde admin admin] PATH_INFO: `/v3/projects/df2970428f484b01b583ce6028758fd5/users/23427e66dfa849c097b818ca540e01f9/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:55.721583 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 941/1864] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:55.722933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0383c3-6283-4b1d-8a3b-099101e099f6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:55.729688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53365dd5-cfff-4b13-ae75-0b8b1b4a4dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2970428f484b01b583ce6028758fd5, user_id=23427e66dfa849c097b818ca540e01f9, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:55.732373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53365dd5-cfff-4b13-ae75-0b8b1b4a4dde admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:55.733328 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0383c3-6283-4b1d-8a3b-099101e099f6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:55.739114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0e08-0d3a-4d83-b9b7-04902ca8ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:55.739114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0e08-0d3a-4d83-b9b7-04902ca8ed8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:55.739317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0e08-0d3a-4d83-b9b7-04902ca8ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:55.739727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0e08-0d3a-4d83-b9b7-04902ca8ed8b admin admin] PATH_INFO: `/v3/projects/bc688068a153400fa607dfbec54f2551/users/ab6e91ed42a64d6e9fcf76e6eec73846/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:55.760547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed0e08-0d3a-4d83-b9b7-04902ca8ed8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc688068a153400fa607dfbec54f2551, user_id=ab6e91ed42a64d6e9fcf76e6eec73846, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:55.763209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed0e08-0d3a-4d83-b9b7-04902ca8ed8b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:55.872049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 924/1865] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:55 2022] PUT /identity/v3/projects/df2970428f484b01b583ce6028758fd5/users/23427e66dfa849c097b818ca540e01f9/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:55.875743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53365dd5-cfff-4b13-ae75-0b8b1b4a4dde admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:55.884813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 942/1866] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:55 2022] PUT /identity/v3/projects/bc688068a153400fa607dfbec54f2551/users/ab6e91ed42a64d6e9fcf76e6eec73846/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:55.896229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204b49-697d-473c-a6d0-e02791486ed9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:55.896596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204b49-697d-473c-a6d0-e02791486ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:55.899703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204b49-697d-473c-a6d0-e02791486ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:55.956426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7a204b49-697d-473c-a6d0-e02791486ed9 None None] MFA Rules not processed for user `ab6e91ed42a64d6e9fcf76e6eec73846`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:55.963894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7a204b49-697d-473c-a6d0-e02791486ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:55.993980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53365dd5-cfff-4b13-ae75-0b8b1b4a4dde admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:56.117262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 943/1867] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:46:56.123005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a204b49-697d-473c-a6d0-e02791486ed9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:56.126555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faa84c-13a5-46d4-ada4-36312741ef3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:56.127269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faa84c-13a5-46d4-ada4-36312741ef3d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.127560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faa84c-13a5-46d4-ada4-36312741ef3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.127846 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98faa84c-13a5-46d4-ada4-36312741ef3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.128623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faa84c-13a5-46d4-ada4-36312741ef3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:56.131486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98faa84c-13a5-46d4-ada4-36312741ef3d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:56.143755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a204b49-697d-473c-a6d0-e02791486ed9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:56.152292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8052e37-faf4-4f16-a7d5-6dd80e8ffe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:56.153048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8052e37-faf4-4f16-a7d5-6dd80e8ffe81 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.153495 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8052e37-faf4-4f16-a7d5-6dd80e8ffe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.154216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8052e37-faf4-4f16-a7d5-6dd80e8ffe81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.155004 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8052e37-faf4-4f16-a7d5-6dd80e8ffe81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:56.161163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8052e37-faf4-4f16-a7d5-6dd80e8ffe81 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:56.170190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 925/1868] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:56.177085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faa84c-13a5-46d4-ada4-36312741ef3d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:56.193123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98faa84c-13a5-46d4-ada4-36312741ef3d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:56.199781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256193e-2a40-4da2-bbed-21dae3ef731d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:56.202244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256193e-2a40-4da2-bbed-21dae3ef731d admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.202244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256193e-2a40-4da2-bbed-21dae3ef731d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.202244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256193e-2a40-4da2-bbed-21dae3ef731d admin admin] PATH_INFO: `/v3/projects/df2970428f484b01b583ce6028758fd5/users/23427e66dfa849c097b818ca540e01f9/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.203433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256193e-2a40-4da2-bbed-21dae3ef731d admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2970428f484b01b583ce6028758fd5, user_id=23427e66dfa849c097b818ca540e01f9, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:56.206263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256193e-2a40-4da2-bbed-21dae3ef731d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:56.233785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 926/1869] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:56 2022] PUT /identity/v3/projects/df2970428f484b01b583ce6028758fd5/users/23427e66dfa849c097b818ca540e01f9/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:56.236253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f70db1-26d6-45ef-92dc-7b7913d51c73 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.236778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f70db1-26d6-45ef-92dc-7b7913d51c73 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.237410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f70db1-26d6-45ef-92dc-7b7913d51c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.271496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e3f70db1-26d6-45ef-92dc-7b7913d51c73 None None] MFA Rules not processed for user `23427e66dfa849c097b818ca540e01f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:56.272840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e3f70db1-26d6-45ef-92dc-7b7913d51c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:56.344697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 944/1870] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:46:56 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:46:56.348190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8052e37-faf4-4f16-a7d5-6dd80e8ffe81 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:56.357160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 927/1871] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:56 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:56.365295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f70db1-26d6-45ef-92dc-7b7913d51c73 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:56.420762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8052e37-faf4-4f16-a7d5-6dd80e8ffe81 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:56.426960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd73af1-3547-4182-bddb-8cb8df66aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:56.427648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73af1-3547-4182-bddb-8cb8df66aef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.435674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73af1-3547-4182-bddb-8cb8df66aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.435803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f70db1-26d6-45ef-92dc-7b7913d51c73 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:56.435894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd73af1-3547-4182-bddb-8cb8df66aef6 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.435894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd73af1-3547-4182-bddb-8cb8df66aef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:56.435894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd73af1-3547-4182-bddb-8cb8df66aef6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:56.498943 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950da31-f4d2-410b-ad0e-8d2ed612bde0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:56.499609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950da31-f4d2-410b-ad0e-8d2ed612bde0 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.500104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950da31-f4d2-410b-ad0e-8d2ed612bde0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.500218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950da31-f4d2-410b-ad0e-8d2ed612bde0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.536791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 945/1872] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:46:56 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:46:56.541759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd73af1-3547-4182-bddb-8cb8df66aef6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:56.551061 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd73af1-3547-4182-bddb-8cb8df66aef6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:56.557067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b55e8-690a-437a-8472-68c866fe0942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:56.558008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b55e8-690a-437a-8472-68c866fe0942 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.558364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b55e8-690a-437a-8472-68c866fe0942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.558705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b55e8-690a-437a-8472-68c866fe0942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.559709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b55e8-690a-437a-8472-68c866fe0942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:56.561137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b55e8-690a-437a-8472-68c866fe0942 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:56.576378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 946/1873] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:56.580201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b55e8-690a-437a-8472-68c866fe0942 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:56.582432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950da31-f4d2-410b-ad0e-8d2ed612bde0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:56.584394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950da31-f4d2-410b-ad0e-8d2ed612bde0 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:56.592952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b55e8-690a-437a-8472-68c866fe0942 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:56.598450 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c317b30-60e5-420c-8c86-e6521e1f376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:56.599756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317b30-60e5-420c-8c86-e6521e1f376e admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.600164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317b30-60e5-420c-8c86-e6521e1f376e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.601102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c317b30-60e5-420c-8c86-e6521e1f376e admin admin] PATH_INFO: `/v3/projects/67af75757dcb4c3bb581cf440352ff84/users/bb57283fcfb84c4480a4f274ae3dc618/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.608470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 928/1874] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:56 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:46:56.623417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c317b30-60e5-420c-8c86-e6521e1f376e admin admin] RBAC: Authorizing `identity:create_grant(project_id=67af75757dcb4c3bb581cf440352ff84, user_id=bb57283fcfb84c4480a4f274ae3dc618, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:56.628930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c317b30-60e5-420c-8c86-e6521e1f376e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:56.748850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 947/1875] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:56 2022] PUT /identity/v3/projects/67af75757dcb4c3bb581cf440352ff84/users/bb57283fcfb84c4480a4f274ae3dc618/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:56.753233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950da31-f4d2-410b-ad0e-8d2ed612bde0 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:56.771740 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950da31-f4d2-410b-ad0e-8d2ed612bde0 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:56.848944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85303ad4-cc66-4290-b470-f890cea17cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:56.849644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85303ad4-cc66-4290-b470-f890cea17cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.849937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85303ad4-cc66-4290-b470-f890cea17cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.850216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85303ad4-cc66-4290-b470-f890cea17cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.851234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85303ad4-cc66-4290-b470-f890cea17cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:56.856063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85303ad4-cc66-4290-b470-f890cea17cc9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:56.869282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 929/1876] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:46:56.875556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c317b30-60e5-420c-8c86-e6521e1f376e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:56.894876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c317b30-60e5-420c-8c86-e6521e1f376e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:56.900449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb66ae-787d-4d75-9efd-4ce4b110540b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:56.901354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb66ae-787d-4d75-9efd-4ce4b110540b admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.901639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb66ae-787d-4d75-9efd-4ce4b110540b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.901953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb66ae-787d-4d75-9efd-4ce4b110540b admin admin] PATH_INFO: `/v3/projects/67af75757dcb4c3bb581cf440352ff84/users/bb57283fcfb84c4480a4f274ae3dc618/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.903995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb66ae-787d-4d75-9efd-4ce4b110540b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67af75757dcb4c3bb581cf440352ff84, user_id=bb57283fcfb84c4480a4f274ae3dc618, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:56.906767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fb66ae-787d-4d75-9efd-4ce4b110540b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:56.918555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 948/1877] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:46:56 2022] PUT /identity/v3/projects/67af75757dcb4c3bb581cf440352ff84/users/bb57283fcfb84c4480a4f274ae3dc618/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:46:56.930297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fab5c-f3a3-4a31-9e42-14e3ce9283d1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:56.930808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fab5c-f3a3-4a31-9e42-14e3ce9283d1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:56.931295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fab5c-f3a3-4a31-9e42-14e3ce9283d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:56.968388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-460fab5c-f3a3-4a31-9e42-14e3ce9283d1 None None] MFA Rules not processed for user `bb57283fcfb84c4480a4f274ae3dc618`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:46:56.969627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-460fab5c-f3a3-4a31-9e42-14e3ce9283d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:46:57.050337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 930/1878] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:46:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:46:57.207431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb66ae-787d-4d75-9efd-4ce4b110540b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:57.301553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fb66ae-787d-4d75-9efd-4ce4b110540b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:57.305463 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac6931-ea47-4a90-b65f-2c850e69ca3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:57.306181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac6931-ea47-4a90-b65f-2c850e69ca3d service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:57.306456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac6931-ea47-4a90-b65f-2c850e69ca3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:57.306735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac6931-ea47-4a90-b65f-2c850e69ca3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:57.318234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac6931-ea47-4a90-b65f-2c850e69ca3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:57.321471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ac6931-ea47-4a90-b65f-2c850e69ca3d service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:57.339907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 949/1879] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:57.439651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fab5c-f3a3-4a31-9e42-14e3ce9283d1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:46:57.450251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fab5c-f3a3-4a31-9e42-14e3ce9283d1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:46:57.454195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a29e704-6043-4c64-9aa6-0ac9aefb97a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:46:57.454838 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29e704-6043-4c64-9aa6-0ac9aefb97a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:46:57.455266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29e704-6043-4c64-9aa6-0ac9aefb97a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:46:57.455384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a29e704-6043-4c64-9aa6-0ac9aefb97a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:46:57.518201 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29e704-6043-4c64-9aa6-0ac9aefb97a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:46:57.519664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a29e704-6043-4c64-9aa6-0ac9aefb97a7 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:46:57.531545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 931/1880] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:46:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:58.342920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:58.878671 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:01.422371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:01.666204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac6931-ea47-4a90-b65f-2c850e69ca3d service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:01.796360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ac6931-ea47-4a90-b65f-2c850e69ca3d service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:01.797445 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:01.798466 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:01.798821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:01.799166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] PATH_INFO: `/v3/users/ab6e91ed42a64d6e9fcf76e6eec73846` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:01.801211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6e91ed42a64d6e9fcf76e6eec73846)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:01.803572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:01.858445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:02.052653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6e91ed42a64d6e9fcf76e6eec73846'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:02.053429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6e91ed42a64d6e9fcf76e6eec73846'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:02.175971 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6e91ed42a64d6e9fcf76e6eec73846'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:02.176685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6e91ed42a64d6e9fcf76e6eec73846'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:02.201372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6e91ed42a64d6e9fcf76e6eec73846'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:02.227293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 950/1881] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:01 2022] DELETE /identity/v3/users/ab6e91ed42a64d6e9fcf76e6eec73846 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:02.232033 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afa595-6f3d-4829-81bb-f54bd71b45ae None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:02.232327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afa595-6f3d-4829-81bb-f54bd71b45ae None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:02.232610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1afa595-6f3d-4829-81bb-f54bd71b45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:02.252942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e1afa595-6f3d-4829-81bb-f54bd71b45ae None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:02.254579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e1afa595-6f3d-4829-81bb-f54bd71b45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:02.340063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 932/1882] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:02.352153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:02.353574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:02.449127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c05d67f-3e59-4ae4-99ac-bc5e91b079e3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:02.453315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe895a-af40-4d47-998d-555923063e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:02.454350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe895a-af40-4d47-998d-555923063e81 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:02.454718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe895a-af40-4d47-998d-555923063e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:02.455058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe895a-af40-4d47-998d-555923063e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:02.467191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe895a-af40-4d47-998d-555923063e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:02.468789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe895a-af40-4d47-998d-555923063e81 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:02.481060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 951/1883] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:02.814642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:03.036208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afa595-6f3d-4829-81bb-f54bd71b45ae None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:03.037596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e1afa595-6f3d-4829-81bb-f54bd71b45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:03.054308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1afa595-6f3d-4829-81bb-f54bd71b45ae None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:03.069878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:03.071392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:03.071679 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:03.086852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] PATH_INFO: `/v3/projects/bc688068a153400fa607dfbec54f2551` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:03.090898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc688068a153400fa607dfbec54f2551)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:03.093779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:03.287916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc688068a153400fa607dfbec54f2551', 'request_id': 'req-0426db7c-9b72-4f8c-8a8d-e73965338329'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.293358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc688068a153400fa607dfbec54f2551', 'request_id': 'req-0426db7c-9b72-4f8c-8a8d-e73965338329'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.300261 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc688068a153400fa607dfbec54f2551', 'request_id': 'req-0426db7c-9b72-4f8c-8a8d-e73965338329'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.384400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe895a-af40-4d47-998d-555923063e81 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:03.385913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eabe895a-af40-4d47-998d-555923063e81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:03.399138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe895a-af40-4d47-998d-555923063e81 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:03.423120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] The token cache is being invalidate because project bc688068a153400fa607dfbec54f2551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:03.423461 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.424182 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.427808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 933/1884] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:03 2022] DELETE /identity/v3/projects/bc688068a153400fa607dfbec54f2551 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:03.432484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:03.434159 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:03.466012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:03.467243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:03.467243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:03.467477 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] PATH_INFO: `/v3/users/5b2c543cb41f4790a00cb15f1c49f03d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:03.468854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2c543cb41f4790a00cb15f1c49f03d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:03.470844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:03.517039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426db7c-9b72-4f8c-8a8d-e73965338329 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:03.522580 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:03.523739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:03.524022 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:03.524495 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] PATH_INFO: `/v3/users/bb57283fcfb84c4480a4f274ae3dc618` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:03.526011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb57283fcfb84c4480a4f274ae3dc618)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:03.528238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:03.784590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb57283fcfb84c4480a4f274ae3dc618'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.791900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2c543cb41f4790a00cb15f1c49f03d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.792621 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2c543cb41f4790a00cb15f1c49f03d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.913240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb57283fcfb84c4480a4f274ae3dc618'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.914660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb57283fcfb84c4480a4f274ae3dc618'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.915399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb57283fcfb84c4480a4f274ae3dc618'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.929596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ca3f36f0-2980-4e10-a2ce-a09fa3d65fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb57283fcfb84c4480a4f274ae3dc618'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.942063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 934/1885] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:03 2022] DELETE /identity/v3/users/bb57283fcfb84c4480a4f274ae3dc618 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:03.992960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2c543cb41f4790a00cb15f1c49f03d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:03.993963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2c543cb41f4790a00cb15f1c49f03d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:04.013483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2c543cb41f4790a00cb15f1c49f03d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:04.035526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 952/1886] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:03 2022] DELETE /identity/v3/users/5b2c543cb41f4790a00cb15f1c49f03d => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:04.037465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240474c0-849a-4718-9c99-e460269e8295 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:04.041418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240474c0-849a-4718-9c99-e460269e8295 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:04.041418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240474c0-849a-4718-9c99-e460269e8295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:04.061869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-240474c0-849a-4718-9c99-e460269e8295 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:04.063161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-240474c0-849a-4718-9c99-e460269e8295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:04.150091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 935/1887] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:04.170596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:04.172171 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:04.253359 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bca0fe-31de-40e0-a12f-51827d94c76f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:04.258760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9181632-a858-4e4d-92e9-d55c89612b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:04.259871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181632-a858-4e4d-92e9-d55c89612b30 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:04.260415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181632-a858-4e4d-92e9-d55c89612b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:04.260766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9181632-a858-4e4d-92e9-d55c89612b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:04.274755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9181632-a858-4e4d-92e9-d55c89612b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:04.274755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9181632-a858-4e4d-92e9-d55c89612b30 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:04.286317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 953/1888] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:04.523233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:04.606335 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:05.263731 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240474c0-849a-4718-9c99-e460269e8295 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:05.265781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-240474c0-849a-4718-9c99-e460269e8295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:05.282064 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240474c0-849a-4718-9c99-e460269e8295 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:05.298491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:05.300904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:05.302240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:05.302926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] PATH_INFO: `/v3/projects/67af75757dcb4c3bb581cf440352ff84` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:05.305202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67af75757dcb4c3bb581cf440352ff84)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:05.307892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:05.406110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9181632-a858-4e4d-92e9-d55c89612b30 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:05.407789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c9181632-a858-4e4d-92e9-d55c89612b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:05.421925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9181632-a858-4e4d-92e9-d55c89612b30 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:05.427791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:05.428674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:05.428965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:05.429252 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] PATH_INFO: `/v3/projects/6e4a7dd7448845bb8586ee9a52f48e05` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:05.430659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4a7dd7448845bb8586ee9a52f48e05)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:05.432603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:05.467389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67af75757dcb4c3bb581cf440352ff84', 'request_id': 'req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.473048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67af75757dcb4c3bb581cf440352ff84', 'request_id': 'req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.480453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67af75757dcb4c3bb581cf440352ff84', 'request_id': 'req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.571224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] The token cache is being invalidate because project 67af75757dcb4c3bb581cf440352ff84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:05.571747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.572164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f86ae749-5b8f-405e-8dba-2a4cf9ff5874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.573841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 936/1889] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:05 2022] DELETE /identity/v3/projects/67af75757dcb4c3bb581cf440352ff84 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:05.578920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb71e0-72ed-4e44-bc00-de3488c325a7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:05.579403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb71e0-72ed-4e44-bc00-de3488c325a7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:05.579689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb71e0-72ed-4e44-bc00-de3488c325a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:05.587678 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4a7dd7448845bb8586ee9a52f48e05', 'request_id': 'req-068c3c2a-5049-4434-9229-ee2a1ed6c870'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.593467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4a7dd7448845bb8586ee9a52f48e05', 'request_id': 'req-068c3c2a-5049-4434-9229-ee2a1ed6c870'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.601043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4a7dd7448845bb8586ee9a52f48e05', 'request_id': 'req-068c3c2a-5049-4434-9229-ee2a1ed6c870'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.613800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-edbb71e0-72ed-4e44-bc00-de3488c325a7 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:05.615078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-edbb71e0-72ed-4e44-bc00-de3488c325a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:05.681743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] The token cache is being invalidate because project 6e4a7dd7448845bb8586ee9a52f48e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:05.682196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.682922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.684801 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 954/1890] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:05 2022] DELETE /identity/v3/projects/6e4a7dd7448845bb8586ee9a52f48e05 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:05.687593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 937/1891] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:05.688618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:05.690899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:05.694172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da60d2-bb33-451b-8990-48fa92d94343 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:05.694719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da60d2-bb33-451b-8990-48fa92d94343 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:05.695517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da60d2-bb33-451b-8990-48fa92d94343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:05.706963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068c3c2a-5049-4434-9229-ee2a1ed6c870 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:05.713129 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:05.714049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:05.714338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:05.714620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] PATH_INFO: `/v3/users/608c85e95763472687f85133147134b2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:05.715846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=608c85e95763472687f85133147134b2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:05.717135 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f7da60d2-bb33-451b-8990-48fa92d94343 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:05.717946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:05.718684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f7da60d2-bb33-451b-8990-48fa92d94343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:05.728150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 938/1892] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:05.732042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da60d2-bb33-451b-8990-48fa92d94343 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:05.742136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da60d2-bb33-451b-8990-48fa92d94343 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:05.746919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6104a-ca24-4faa-99a6-db97586e2249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:05.747573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6104a-ca24-4faa-99a6-db97586e2249 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:05.747856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6104a-ca24-4faa-99a6-db97586e2249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:05.748133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6104a-ca24-4faa-99a6-db97586e2249 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:05.748860 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6104a-ca24-4faa-99a6-db97586e2249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:05.749166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6104a-ca24-4faa-99a6-db97586e2249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:05.750858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6104a-ca24-4faa-99a6-db97586e2249 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:05.762895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 939/1893] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:47:05.767289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6104a-ca24-4faa-99a6-db97586e2249 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:05.778157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6104a-ca24-4faa-99a6-db97586e2249 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:05.782990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd7b19-9f0c-4ee8-b4d0-3f474ebc0762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:05.783635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd7b19-9f0c-4ee8-b4d0-3f474ebc0762 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:05.783918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd7b19-9f0c-4ee8-b4d0-3f474ebc0762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:05.785627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd7b19-9f0c-4ee8-b4d0-3f474ebc0762 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:05.785627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd7b19-9f0c-4ee8-b4d0-3f474ebc0762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:05.786795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dd7b19-9f0c-4ee8-b4d0-3f474ebc0762 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:05.869418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 940/1894] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:05 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:05.873383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd7b19-9f0c-4ee8-b4d0-3f474ebc0762 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:05.905501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:05.918708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608c85e95763472687f85133147134b2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.919386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608c85e95763472687f85133147134b2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.943708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd7b19-9f0c-4ee8-b4d0-3f474ebc0762 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:05.951778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e08e76-9031-4127-8e27-2f6a37a02cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:05.952475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e08e76-9031-4127-8e27-2f6a37a02cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:05.952754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e08e76-9031-4127-8e27-2f6a37a02cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:05.953031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e08e76-9031-4127-8e27-2f6a37a02cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:05.953754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e08e76-9031-4127-8e27-2f6a37a02cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:05.955762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e08e76-9031-4127-8e27-2f6a37a02cf9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:05.986001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608c85e95763472687f85133147134b2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:05.986672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608c85e95763472687f85133147134b2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:06.012085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608c85e95763472687f85133147134b2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:06.025487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 955/1895] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:05 2022] DELETE /identity/v3/users/608c85e95763472687f85133147134b2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:06.068984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 941/1896] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:05 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:06.073939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:06.075422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:06.159292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8715259-6796-4a2c-b91b-8a98a676bd0b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:06.164551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12347a-e506-4e7c-b36c-e47042d23906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:06.165264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12347a-e506-4e7c-b36c-e47042d23906 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:06.165532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12347a-e506-4e7c-b36c-e47042d23906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:06.165862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12347a-e506-4e7c-b36c-e47042d23906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:06.166603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12347a-e506-4e7c-b36c-e47042d23906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:06.168232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12347a-e506-4e7c-b36c-e47042d23906 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:06.178724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 956/1897] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:06.183496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e08e76-9031-4127-8e27-2f6a37a02cf9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:06.194492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e08e76-9031-4127-8e27-2f6a37a02cf9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:06.200221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88289094-b777-44d9-9f30-6c9a1f2d5113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:06.200922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289094-b777-44d9-9f30-6c9a1f2d5113 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:06.201210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289094-b777-44d9-9f30-6c9a1f2d5113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:06.201491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88289094-b777-44d9-9f30-6c9a1f2d5113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:06.202419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88289094-b777-44d9-9f30-6c9a1f2d5113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:06.204033 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88289094-b777-44d9-9f30-6c9a1f2d5113 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:06.215019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 942/1898] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:06.219502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12347a-e506-4e7c-b36c-e47042d23906 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:06.230507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12347a-e506-4e7c-b36c-e47042d23906 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:06.235532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ca723-ea78-4d4c-ab6d-1916765b3192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:06.236520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ca723-ea78-4d4c-ab6d-1916765b3192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:06.236806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ca723-ea78-4d4c-ab6d-1916765b3192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:06.237085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ca723-ea78-4d4c-ab6d-1916765b3192 admin admin] PATH_INFO: `/v3/projects/62bf6733067b40148ceb22d77585cbdc/users/c5612c2293de43399f6b35516205ec89/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:06.254298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ca723-ea78-4d4c-ab6d-1916765b3192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62bf6733067b40148ceb22d77585cbdc, user_id=c5612c2293de43399f6b35516205ec89, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:06.257102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ca723-ea78-4d4c-ab6d-1916765b3192 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:06.369762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 957/1899] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:06 2022] PUT /identity/v3/projects/62bf6733067b40148ceb22d77585cbdc/users/c5612c2293de43399f6b35516205ec89/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:06.379032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afdbea-1d13-4a98-b552-b7fe0f7ddb11 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:06.379693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afdbea-1d13-4a98-b552-b7fe0f7ddb11 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:06.379693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33afdbea-1d13-4a98-b552-b7fe0f7ddb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:06.410848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-33afdbea-1d13-4a98-b552-b7fe0f7ddb11 None None] MFA Rules not processed for user `c5612c2293de43399f6b35516205ec89`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:06.412151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-33afdbea-1d13-4a98-b552-b7fe0f7ddb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:06.486075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 943/1900] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:06.498251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ca723-ea78-4d4c-ab6d-1916765b3192 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:06.500012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-528ca723-ea78-4d4c-ab6d-1916765b3192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:06.558441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ca723-ea78-4d4c-ab6d-1916765b3192 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:06.562204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29efba8e-c4df-466f-8eb3-1dfb2217bcc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:06.565886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efba8e-c4df-466f-8eb3-1dfb2217bcc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:06.567591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efba8e-c4df-466f-8eb3-1dfb2217bcc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:06.567701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afdbea-1d13-4a98-b552-b7fe0f7ddb11 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:06.567793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29efba8e-c4df-466f-8eb3-1dfb2217bcc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:06.568701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-33afdbea-1d13-4a98-b552-b7fe0f7ddb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:06.578344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efba8e-c4df-466f-8eb3-1dfb2217bcc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:06.579846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29efba8e-c4df-466f-8eb3-1dfb2217bcc1 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:06.590189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 958/1901] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:06.600660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:06.656184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33afdbea-1d13-4a98-b552-b7fe0f7ddb11 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:06.662804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:06.664383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:06.664671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:06.664952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] PATH_INFO: `/v3/projects/4fdc35e75ff34ad09e23f554a30b52fb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:06.666207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fdc35e75ff34ad09e23f554a30b52fb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:06.668128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:06.718820 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:06.758538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fdc35e75ff34ad09e23f554a30b52fb', 'request_id': 'req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:06.763985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fdc35e75ff34ad09e23f554a30b52fb', 'request_id': 'req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:06.770132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fdc35e75ff34ad09e23f554a30b52fb', 'request_id': 'req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:06.878331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] The token cache is being invalidate because project 4fdc35e75ff34ad09e23f554a30b52fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:06.878629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:06.879283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5f2ab1a8-7c8c-452d-a652-cc8d6d4418a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:06.880861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 944/1902] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:06 2022] DELETE /identity/v3/projects/4fdc35e75ff34ad09e23f554a30b52fb => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:06.886602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ed17-127e-48dd-a448-79c9588ed23f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:06.886892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ed17-127e-48dd-a448-79c9588ed23f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:06.887174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ed17-127e-48dd-a448-79c9588ed23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:06.908266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4706ed17-127e-48dd-a448-79c9588ed23f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:06.909752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4706ed17-127e-48dd-a448-79c9588ed23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:06.972536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 959/1903] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:06.981638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e8c0d-7629-4d14-b43f-b997027c357a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:06.986959 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e8c0d-7629-4d14-b43f-b997027c357a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:06.986959 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e8c0d-7629-4d14-b43f-b997027c357a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:07.002038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-695e8c0d-7629-4d14-b43f-b997027c357a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:07.003427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-695e8c0d-7629-4d14-b43f-b997027c357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:07.015930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 945/1904] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:07.019718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ed17-127e-48dd-a448-79c9588ed23f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:07.031105 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ed17-127e-48dd-a448-79c9588ed23f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:07.038705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d880bb2-e0de-4497-912d-c5dc0d2cbfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:07.039495 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d880bb2-e0de-4497-912d-c5dc0d2cbfdc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:07.039947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d880bb2-e0de-4497-912d-c5dc0d2cbfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:07.040492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d880bb2-e0de-4497-912d-c5dc0d2cbfdc admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:07.041795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d880bb2-e0de-4497-912d-c5dc0d2cbfdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:07.042116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d880bb2-e0de-4497-912d-c5dc0d2cbfdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:07.043774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d880bb2-e0de-4497-912d-c5dc0d2cbfdc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:07.066670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 960/1905] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:07.069554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e8c0d-7629-4d14-b43f-b997027c357a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:07.081348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e8c0d-7629-4d14-b43f-b997027c357a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:07.105629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082916cf-89a7-4485-a5eb-3e15f047c40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:07.106935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082916cf-89a7-4485-a5eb-3e15f047c40a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:07.107437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082916cf-89a7-4485-a5eb-3e15f047c40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:07.107899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082916cf-89a7-4485-a5eb-3e15f047c40a admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:07.108770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082916cf-89a7-4485-a5eb-3e15f047c40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:07.114920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082916cf-89a7-4485-a5eb-3e15f047c40a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:07.263071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 946/1906] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:07 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:07.268034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d880bb2-e0de-4497-912d-c5dc0d2cbfdc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:07.287153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d880bb2-e0de-4497-912d-c5dc0d2cbfdc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:07.368696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c6955-3c2c-4464-bde9-8f0d7ae1825d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:07.369513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c6955-3c2c-4464-bde9-8f0d7ae1825d admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:07.369820 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c6955-3c2c-4464-bde9-8f0d7ae1825d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:07.370094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c6955-3c2c-4464-bde9-8f0d7ae1825d admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:07.370888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c6955-3c2c-4464-bde9-8f0d7ae1825d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:07.372903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c6955-3c2c-4464-bde9-8f0d7ae1825d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:07.484505 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 961/1907] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:07 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:07.486048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082916cf-89a7-4485-a5eb-3e15f047c40a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:07.501770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082916cf-89a7-4485-a5eb-3e15f047c40a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:07.507033 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78420b-9fe8-4241-868d-ff2b04a5331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:07.508594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78420b-9fe8-4241-868d-ff2b04a5331c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:07.509370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78420b-9fe8-4241-868d-ff2b04a5331c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:07.509783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c78420b-9fe8-4241-868d-ff2b04a5331c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:07.510717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78420b-9fe8-4241-868d-ff2b04a5331c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:07.512435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c78420b-9fe8-4241-868d-ff2b04a5331c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:07.526138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 947/1908] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:07.530039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c6955-3c2c-4464-bde9-8f0d7ae1825d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:07.541354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c6955-3c2c-4464-bde9-8f0d7ae1825d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:07.546425 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbd3a1-1add-4973-8072-a290611581d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:07.547721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbd3a1-1add-4973-8072-a290611581d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:07.547874 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbd3a1-1add-4973-8072-a290611581d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:07.548293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecbd3a1-1add-4973-8072-a290611581d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:07.549185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbd3a1-1add-4973-8072-a290611581d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:07.551391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecbd3a1-1add-4973-8072-a290611581d7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:07.563921 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 962/1909] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:07.572925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78420b-9fe8-4241-868d-ff2b04a5331c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:07.583622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c78420b-9fe8-4241-868d-ff2b04a5331c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:07.589643 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2987baa-5a4e-46d3-9828-2ee6b6a5be0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:07.590908 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2987baa-5a4e-46d3-9828-2ee6b6a5be0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:07.592230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2987baa-5a4e-46d3-9828-2ee6b6a5be0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:07.592728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2987baa-5a4e-46d3-9828-2ee6b6a5be0a admin admin] PATH_INFO: `/v3/projects/7f5300101b9c4e809b33e7fa0019cb35/users/a672ef507b5c4aecabb37b3f243d3e5a/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:07.613335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2987baa-5a4e-46d3-9828-2ee6b6a5be0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f5300101b9c4e809b33e7fa0019cb35, user_id=a672ef507b5c4aecabb37b3f243d3e5a, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:07.616278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2987baa-5a4e-46d3-9828-2ee6b6a5be0a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:07.731132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbd3a1-1add-4973-8072-a290611581d7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:07.732812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1ecbd3a1-1add-4973-8072-a290611581d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:07.747374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 948/1910] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:07 2022] PUT /identity/v3/projects/7f5300101b9c4e809b33e7fa0019cb35/users/a672ef507b5c4aecabb37b3f243d3e5a/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:07.757329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecbd3a1-1add-4973-8072-a290611581d7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:07.760013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10db528-4c61-4c28-bb48-de77a2d02867 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:07.760307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10db528-4c61-4c28-bb48-de77a2d02867 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:07.760592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10db528-4c61-4c28-bb48-de77a2d02867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:07.788797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b10db528-4c61-4c28-bb48-de77a2d02867 None None] MFA Rules not processed for user `a672ef507b5c4aecabb37b3f243d3e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:07.790093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b10db528-4c61-4c28-bb48-de77a2d02867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:07.809873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:07.810761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:07.812176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:07.812176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] PATH_INFO: `/v3/users/68108bf2a07a46158968d8dde39d43c3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:07.812512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68108bf2a07a46158968d8dde39d43c3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:07.814467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:07.861117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 949/1911] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:07.865614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10db528-4c61-4c28-bb48-de77a2d02867 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:07.875671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10db528-4c61-4c28-bb48-de77a2d02867 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:07.880256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f03828-f576-468d-be2d-dbdd88423057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:07.880896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03828-f576-468d-be2d-dbdd88423057 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:07.881199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03828-f576-468d-be2d-dbdd88423057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:07.881457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03828-f576-468d-be2d-dbdd88423057 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:07.882225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f03828-f576-468d-be2d-dbdd88423057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:07.884672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f03828-f576-468d-be2d-dbdd88423057 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:07.895662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:08.022109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 950/1912] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:07 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:08.026190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f03828-f576-468d-be2d-dbdd88423057 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:08.064923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68108bf2a07a46158968d8dde39d43c3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:08.065658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68108bf2a07a46158968d8dde39d43c3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:08.092588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f03828-f576-468d-be2d-dbdd88423057 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:08.097430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f93de-5da9-42b9-83fa-b6df7ca31c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:08.098145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f93de-5da9-42b9-83fa-b6df7ca31c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:08.098426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f93de-5da9-42b9-83fa-b6df7ca31c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:08.098708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f93de-5da9-42b9-83fa-b6df7ca31c95 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:08.099430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f93de-5da9-42b9-83fa-b6df7ca31c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:08.102155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f93de-5da9-42b9-83fa-b6df7ca31c95 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:08.181938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:08.215444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68108bf2a07a46158968d8dde39d43c3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:08.216110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68108bf2a07a46158968d8dde39d43c3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:08.224575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 951/1913] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:08 2022] POST /identity/v3/users => generated 300 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:08.225927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f93de-5da9-42b9-83fa-b6df7ca31c95 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:08.228287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a09f93de-5da9-42b9-83fa-b6df7ca31c95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:08.230707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5a90542-a5f0-40d8-bcae-fe8b0137903f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68108bf2a07a46158968d8dde39d43c3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:08.240834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f93de-5da9-42b9-83fa-b6df7ca31c95 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:08.244563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 963/1914] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:07 2022] DELETE /identity/v3/users/68108bf2a07a46158968d8dde39d43c3 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:08.247598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becbe07-bb5a-475d-a715-93a58e023f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:08.247598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becbe07-bb5a-475d-a715-93a58e023f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:08.247598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becbe07-bb5a-475d-a715-93a58e023f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:08.247909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becbe07-bb5a-475d-a715-93a58e023f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:08.248540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becbe07-bb5a-475d-a715-93a58e023f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:08.250245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becbe07-bb5a-475d-a715-93a58e023f04 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:08.251287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a76b3-f59c-4db7-9f5e-eacc37d2291a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:08.251590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a76b3-f59c-4db7-9f5e-eacc37d2291a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:08.251867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a76b3-f59c-4db7-9f5e-eacc37d2291a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:08.265113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 952/1915] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:08.266552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becbe07-bb5a-475d-a715-93a58e023f04 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:08.269556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-510a76b3-f59c-4db7-9f5e-eacc37d2291a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:08.270614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-510a76b3-f59c-4db7-9f5e-eacc37d2291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:08.281601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becbe07-bb5a-475d-a715-93a58e023f04 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:08.339387 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 964/1916] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:08.340155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313ece-c4ba-4e4f-986f-d8785b5ae5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:08.341337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313ece-c4ba-4e4f-986f-d8785b5ae5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:08.341625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313ece-c4ba-4e4f-986f-d8785b5ae5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:08.341938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec313ece-c4ba-4e4f-986f-d8785b5ae5dd admin admin] PATH_INFO: `/v3/projects/1183b409c6b0483c9c415bdc4f78c94f/users/106b76aa664b416c8ce3100de88e43bb/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:08.353962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a76b3-f59c-4db7-9f5e-eacc37d2291a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:08.355362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-510a76b3-f59c-4db7-9f5e-eacc37d2291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:08.363970 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec313ece-c4ba-4e4f-986f-d8785b5ae5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1183b409c6b0483c9c415bdc4f78c94f, user_id=106b76aa664b416c8ce3100de88e43bb, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:08.366774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec313ece-c4ba-4e4f-986f-d8785b5ae5dd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:08.412224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a76b3-f59c-4db7-9f5e-eacc37d2291a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:08.416685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6593e94-b960-41ff-b24b-84884a270fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:08.417343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6593e94-b960-41ff-b24b-84884a270fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:08.417687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6593e94-b960-41ff-b24b-84884a270fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:08.418017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6593e94-b960-41ff-b24b-84884a270fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:08.427063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6593e94-b960-41ff-b24b-84884a270fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:08.428503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6593e94-b960-41ff-b24b-84884a270fb9 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:08.438058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 965/1917] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:08.508032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 953/1918] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:08 2022] PUT /identity/v3/projects/1183b409c6b0483c9c415bdc4f78c94f/users/106b76aa664b416c8ce3100de88e43bb/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:08.511273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6593e94-b960-41ff-b24b-84884a270fb9 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:08.522402 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6593e94-b960-41ff-b24b-84884a270fb9 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:08.589841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070f702-751c-4ebe-abf8-d58f24603753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:08.591403 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f702-751c-4ebe-abf8-d58f24603753 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:08.591403 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f702-751c-4ebe-abf8-d58f24603753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:08.591403 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070f702-751c-4ebe-abf8-d58f24603753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:08.592251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070f702-751c-4ebe-abf8-d58f24603753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:08.593993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070f702-751c-4ebe-abf8-d58f24603753 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:08.604855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 966/1919] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:08.609357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313ece-c4ba-4e4f-986f-d8785b5ae5dd admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:08.620384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec313ece-c4ba-4e4f-986f-d8785b5ae5dd admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:08.625580 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819d36f-672e-4da9-97f3-2f703029b738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:08.626677 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819d36f-672e-4da9-97f3-2f703029b738 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:08.626971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819d36f-672e-4da9-97f3-2f703029b738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:08.627257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819d36f-672e-4da9-97f3-2f703029b738 admin admin] PATH_INFO: `/v3/projects/1183b409c6b0483c9c415bdc4f78c94f/users/106b76aa664b416c8ce3100de88e43bb/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:08.629588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819d36f-672e-4da9-97f3-2f703029b738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1183b409c6b0483c9c415bdc4f78c94f, user_id=106b76aa664b416c8ce3100de88e43bb, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:08.632248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819d36f-672e-4da9-97f3-2f703029b738 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:08.680472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 954/1920] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:08 2022] PUT /identity/v3/projects/1183b409c6b0483c9c415bdc4f78c94f/users/106b76aa664b416c8ce3100de88e43bb/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:08.682307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db5f2e-607a-49f0-982c-44d577688fdd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:08.682599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db5f2e-607a-49f0-982c-44d577688fdd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:08.682875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db5f2e-607a-49f0-982c-44d577688fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:08.730634 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-37db5f2e-607a-49f0-982c-44d577688fdd None None] MFA Rules not processed for user `106b76aa664b416c8ce3100de88e43bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:08.731851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-37db5f2e-607a-49f0-982c-44d577688fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:08.807305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 967/1921] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:08.840714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819d36f-672e-4da9-97f3-2f703029b738 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:08.842606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6819d36f-672e-4da9-97f3-2f703029b738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:08.908444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819d36f-672e-4da9-97f3-2f703029b738 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:08.912104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d87b2-f6c9-4d86-b5e7-a8ead8c6f5a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:08.912752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d87b2-f6c9-4d86-b5e7-a8ead8c6f5a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:08.913036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d87b2-f6c9-4d86-b5e7-a8ead8c6f5a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:08.913386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d87b2-f6c9-4d86-b5e7-a8ead8c6f5a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:08.923093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d87b2-f6c9-4d86-b5e7-a8ead8c6f5a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:08.927099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d87b2-f6c9-4d86-b5e7-a8ead8c6f5a4 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:08.934831 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 955/1922] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:09.028770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db5f2e-607a-49f0-982c-44d577688fdd None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:09.030389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-37db5f2e-607a-49f0-982c-44d577688fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:09.103083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d87b2-f6c9-4d86-b5e7-a8ead8c6f5a4 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:09.113140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d87b2-f6c9-4d86-b5e7-a8ead8c6f5a4 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:09.113415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db5f2e-607a-49f0-982c-44d577688fdd None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:09.117789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:09.118260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:09.118624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:09.118906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:09.119184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] PATH_INFO: `/v3/users/a672ef507b5c4aecabb37b3f243d3e5a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:09.119285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:09.119527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:09.119816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] PATH_INFO: `/v3/projects/37481888b1954e2fbedbb44031f42c64` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:09.120436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=a672ef507b5c4aecabb37b3f243d3e5a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:09.121191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=37481888b1954e2fbedbb44031f42c64)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:09.122451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:09.128967 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:09.360919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a672ef507b5c4aecabb37b3f243d3e5a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.361623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37481888b1954e2fbedbb44031f42c64', 'request_id': 'req-5a190b5d-9b31-4de3-97a3-0684177140cd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.367374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37481888b1954e2fbedbb44031f42c64', 'request_id': 'req-5a190b5d-9b31-4de3-97a3-0684177140cd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.373580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37481888b1954e2fbedbb44031f42c64', 'request_id': 'req-5a190b5d-9b31-4de3-97a3-0684177140cd'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.473349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a672ef507b5c4aecabb37b3f243d3e5a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.473823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a672ef507b5c4aecabb37b3f243d3e5a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.474458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a672ef507b5c4aecabb37b3f243d3e5a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.487120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a672ef507b5c4aecabb37b3f243d3e5a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.499130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 956/1923] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:09 2022] DELETE /identity/v3/users/a672ef507b5c4aecabb37b3f243d3e5a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:09.500116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:09.501464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:09.534661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] The token cache is being invalidate because project 37481888b1954e2fbedbb44031f42c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:09.535055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.535688 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5a190b5d-9b31-4de3-97a3-0684177140cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.537233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 968/1924] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:09 2022] DELETE /identity/v3/projects/37481888b1954e2fbedbb44031f42c64 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:09.540227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5aca1-b40e-45d2-b79a-cf4f2877be6c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:09.540227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5aca1-b40e-45d2-b79a-cf4f2877be6c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:09.540227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a5aca1-b40e-45d2-b79a-cf4f2877be6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:09.558272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c8a5aca1-b40e-45d2-b79a-cf4f2877be6c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:09.559485 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c8a5aca1-b40e-45d2-b79a-cf4f2877be6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:09.567092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 969/1925] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:09.585578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87cda6b-f31c-408a-84bc-93cb07af55ef admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:09.586747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5aca1-b40e-45d2-b79a-cf4f2877be6c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:09.586747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c8a5aca1-b40e-45d2-b79a-cf4f2877be6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:09.586913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:09.586913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:09.586913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:09.586913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] PATH_INFO: `/v3/users/db726e2e19aa42c1b339b8dff90fa162` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:09.587179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db726e2e19aa42c1b339b8dff90fa162)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:09.587179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:09.587311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a5aca1-b40e-45d2-b79a-cf4f2877be6c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:09.593430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:09.594360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:09.594649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:09.594924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] PATH_INFO: `/v3/users/441d5c8aa9884239a122faa6c6da04e2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:09.596325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] RBAC: Authorizing `identity:delete_user(user_id=441d5c8aa9884239a122faa6c6da04e2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:09.598303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:09.800842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db726e2e19aa42c1b339b8dff90fa162'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.824334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441d5c8aa9884239a122faa6c6da04e2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.825413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441d5c8aa9884239a122faa6c6da04e2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.878626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db726e2e19aa42c1b339b8dff90fa162'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.879348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db726e2e19aa42c1b339b8dff90fa162'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.879996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db726e2e19aa42c1b339b8dff90fa162'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.893160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db726e2e19aa42c1b339b8dff90fa162'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.905903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 957/1926] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:09 2022] DELETE /identity/v3/users/db726e2e19aa42c1b339b8dff90fa162 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:09.906904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:09.908293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:09.946167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441d5c8aa9884239a122faa6c6da04e2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.946895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441d5c8aa9884239a122faa6c6da04e2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.961178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-834fdbe3-d1cc-4d2c-82aa-959804d3a759 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441d5c8aa9884239a122faa6c6da04e2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:09.970039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bf0d8-ffb0-4c22-b4b4-694d1f1bdff3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:09.973797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69acd27-9b76-40a8-8d5d-71dea0348e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:09.974471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69acd27-9b76-40a8-8d5d-71dea0348e0e service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:09.974759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69acd27-9b76-40a8-8d5d-71dea0348e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:09.975044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69acd27-9b76-40a8-8d5d-71dea0348e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:09.977343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a69acd27-9b76-40a8-8d5d-71dea0348e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:09.988096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 970/1927] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:09 2022] DELETE /identity/v3/users/441d5c8aa9884239a122faa6c6da04e2 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:09.994722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2da59-645e-4b18-8e90-4b94acf5b409 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:09.994722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2da59-645e-4b18-8e90-4b94acf5b409 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:09.994722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d2da59-645e-4b18-8e90-4b94acf5b409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:10.024221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-15d2da59-645e-4b18-8e90-4b94acf5b409 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:10.024221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-15d2da59-645e-4b18-8e90-4b94acf5b409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:10.055859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69acd27-9b76-40a8-8d5d-71dea0348e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:10.057647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69acd27-9b76-40a8-8d5d-71dea0348e0e service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:10.068544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 958/1928] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:10.103551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 971/1929] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:10.109387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69acd27-9b76-40a8-8d5d-71dea0348e0e service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:10.110930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a69acd27-9b76-40a8-8d5d-71dea0348e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:10.131923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69acd27-9b76-40a8-8d5d-71dea0348e0e service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:10.184259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499e412-b432-4780-a579-277ed179f532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:10.184877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e412-b432-4780-a579-277ed179f532 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:10.185168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e412-b432-4780-a579-277ed179f532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:10.185453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499e412-b432-4780-a579-277ed179f532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:10.195128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499e412-b432-4780-a579-277ed179f532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:10.196669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499e412-b432-4780-a579-277ed179f532 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:10.206505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 959/1930] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:10.551623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:10.610771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2da59-645e-4b18-8e90-4b94acf5b409 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:10.612775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-15d2da59-645e-4b18-8e90-4b94acf5b409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:10.626540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d2da59-645e-4b18-8e90-4b94acf5b409 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:10.632987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:10.633953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:10.634303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:10.640324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] PATH_INFO: `/v3/projects/dd79556bd065488480dbae0d91f93537` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:10.640324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd79556bd065488480dbae0d91f93537)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:10.640324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:10.643737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499e412-b432-4780-a579-277ed179f532 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:10.645933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a499e412-b432-4780-a579-277ed179f532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:10.665031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499e412-b432-4780-a579-277ed179f532 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:10.673192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:10.674699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:10.674699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:10.674699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] PATH_INFO: `/v3/projects/7f5300101b9c4e809b33e7fa0019cb35` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:10.675914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f5300101b9c4e809b33e7fa0019cb35)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:10.678035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:10.780828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd79556bd065488480dbae0d91f93537', 'request_id': 'req-b82f39d2-b897-491f-badb-f539fcc62068'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:10.786264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd79556bd065488480dbae0d91f93537', 'request_id': 'req-b82f39d2-b897-491f-badb-f539fcc62068'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:10.791755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:10.795617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd79556bd065488480dbae0d91f93537', 'request_id': 'req-b82f39d2-b897-491f-badb-f539fcc62068'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:10.809350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f5300101b9c4e809b33e7fa0019cb35', 'request_id': 'req-3a0653d4-a473-4a2e-a154-fce0d02a4331'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:10.814804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f5300101b9c4e809b33e7fa0019cb35', 'request_id': 'req-3a0653d4-a473-4a2e-a154-fce0d02a4331'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:10.822191 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f5300101b9c4e809b33e7fa0019cb35', 'request_id': 'req-3a0653d4-a473-4a2e-a154-fce0d02a4331'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:10.923636 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] The token cache is being invalidate because project dd79556bd065488480dbae0d91f93537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:10.924215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:10.924531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:10.926116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 972/1931] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:10 2022] DELETE /identity/v3/projects/dd79556bd065488480dbae0d91f93537 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:10.926870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:10.928176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:11.014718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f39d2-b897-491f-badb-f539fcc62068 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:11.015339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] The token cache is being invalidate because project 7f5300101b9c4e809b33e7fa0019cb35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:11.015739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.016415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3a0653d4-a473-4a2e-a154-fce0d02a4331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.018032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 960/1932] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:10 2022] DELETE /identity/v3/projects/7f5300101b9c4e809b33e7fa0019cb35 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:11.019586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e5b3c-0b6c-48ac-9f5f-cbfc29aefcf9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:11.019829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e5b3c-0b6c-48ac-9f5f-cbfc29aefcf9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:11.020105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e5b3c-0b6c-48ac-9f5f-cbfc29aefcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:11.039769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-034e5b3c-0b6c-48ac-9f5f-cbfc29aefcf9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:11.040985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-034e5b3c-0b6c-48ac-9f5f-cbfc29aefcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:11.086592 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:11.087645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:11.087925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:11.088201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] PATH_INFO: `/v3/projects/7d63b109e08e444d8e540340e2d1c65d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:11.089408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d63b109e08e444d8e540340e2d1c65d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:11.091778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:11.105398 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 961/1933] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:11.106097 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e5b3c-0b6c-48ac-9f5f-cbfc29aefcf9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:11.107401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-034e5b3c-0b6c-48ac-9f5f-cbfc29aefcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:11.119456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e5b3c-0b6c-48ac-9f5f-cbfc29aefcf9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:11.126880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:11.127021 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:11.127238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:11.127516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] PATH_INFO: `/v3/users/106b76aa664b416c8ce3100de88e43bb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:11.128905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=106b76aa664b416c8ce3100de88e43bb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:11.130844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:11.233455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d63b109e08e444d8e540340e2d1c65d', 'request_id': 'req-70cf1462-5d4a-4760-9c64-9c2565ac9f56'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.242590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d63b109e08e444d8e540340e2d1c65d', 'request_id': 'req-70cf1462-5d4a-4760-9c64-9c2565ac9f56'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.247622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d63b109e08e444d8e540340e2d1c65d', 'request_id': 'req-70cf1462-5d4a-4760-9c64-9c2565ac9f56'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.335091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] The token cache is being invalidate because project 7d63b109e08e444d8e540340e2d1c65d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:11.335382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.336023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-70cf1462-5d4a-4760-9c64-9c2565ac9f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.337912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 973/1934] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:10 2022] DELETE /identity/v3/projects/7d63b109e08e444d8e540340e2d1c65d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:11.338908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121aa5-95a4-4624-a212-cfbb93f37b10 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:11.339191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121aa5-95a4-4624-a212-cfbb93f37b10 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:11.339494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3121aa5-95a4-4624-a212-cfbb93f37b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:11.348298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '106b76aa664b416c8ce3100de88e43bb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.358295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c3121aa5-95a4-4624-a212-cfbb93f37b10 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:11.359547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c3121aa5-95a4-4624-a212-cfbb93f37b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:11.420641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 974/1935] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:11.421501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3121aa5-95a4-4624-a212-cfbb93f37b10 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:11.422809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c3121aa5-95a4-4624-a212-cfbb93f37b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:11.435600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3121aa5-95a4-4624-a212-cfbb93f37b10 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:11.440268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:11.441144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:11.441430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:11.441740 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] PATH_INFO: `/v3/users/23427e66dfa849c097b818ca540e01f9` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:11.443106 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23427e66dfa849c097b818ca540e01f9)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:11.443755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '106b76aa664b416c8ce3100de88e43bb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.444360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '106b76aa664b416c8ce3100de88e43bb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.445007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '106b76aa664b416c8ce3100de88e43bb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.445128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:11.461533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '106b76aa664b416c8ce3100de88e43bb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:11.474239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 962/1936] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:11 2022] DELETE /identity/v3/users/106b76aa664b416c8ce3100de88e43bb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:11.475085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:11.476714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:11.544800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4218b22-b2fa-496f-873d-8cf2b035e091 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:11.549310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74139a-43bd-43a5-8056-462e8cc4d35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:11.550105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74139a-43bd-43a5-8056-462e8cc4d35d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:11.550390 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74139a-43bd-43a5-8056-462e8cc4d35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:11.550676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74139a-43bd-43a5-8056-462e8cc4d35d admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:11.551445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74139a-43bd-43a5-8056-462e8cc4d35d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:11.551751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74139a-43bd-43a5-8056-462e8cc4d35d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:11.553361 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74139a-43bd-43a5-8056-462e8cc4d35d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:11.566475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 963/1937] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:11.571111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74139a-43bd-43a5-8056-462e8cc4d35d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:11.581286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74139a-43bd-43a5-8056-462e8cc4d35d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:11.586026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d433c6-b844-42f2-88db-91cc77c440da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:11.586724 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d433c6-b844-42f2-88db-91cc77c440da admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:11.587006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d433c6-b844-42f2-88db-91cc77c440da admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:11.587282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d433c6-b844-42f2-88db-91cc77c440da admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:11.588002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d433c6-b844-42f2-88db-91cc77c440da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:11.589924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d433c6-b844-42f2-88db-91cc77c440da admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:12.047219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23427e66dfa849c097b818ca540e01f9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:12.047814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23427e66dfa849c097b818ca540e01f9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:12.172719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 964/1938] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:11 2022] POST /identity/v3/projects => generated 401 bytes in 603 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:12.176879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d433c6-b844-42f2-88db-91cc77c440da admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:12.178678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c4d433c6-b844-42f2-88db-91cc77c440da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:12.248053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d433c6-b844-42f2-88db-91cc77c440da admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:12.253182 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a4926-37fa-4a8a-a369-b382ebe8eeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:12.253906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a4926-37fa-4a8a-a369-b382ebe8eeaa admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:12.254199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a4926-37fa-4a8a-a369-b382ebe8eeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:12.254482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a4926-37fa-4a8a-a369-b382ebe8eeaa admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:12.255182 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a4926-37fa-4a8a-a369-b382ebe8eeaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:12.257240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a4926-37fa-4a8a-a369-b382ebe8eeaa admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:12.339566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23427e66dfa849c097b818ca540e01f9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:12.342637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23427e66dfa849c097b818ca540e01f9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:12.353781 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23427e66dfa849c097b818ca540e01f9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:12.366759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 975/1939] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:11 2022] DELETE /identity/v3/users/23427e66dfa849c097b818ca540e01f9 => generated 0 bytes in 946 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:12.444743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 965/1940] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:12 2022] POST /identity/v3/users => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:12.451026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:12.515172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2afce3b-c018-498f-8658-304da861fce5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:12.519883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa353d0-cada-4122-b7fc-828d55487e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:12.520569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa353d0-cada-4122-b7fc-828d55487e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:12.520851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa353d0-cada-4122-b7fc-828d55487e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:12.521131 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa353d0-cada-4122-b7fc-828d55487e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:12.521900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa353d0-cada-4122-b7fc-828d55487e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:12.524107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa353d0-cada-4122-b7fc-828d55487e56 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:12.535463 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:12.536301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 976/1941] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:12.545947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a4926-37fa-4a8a-a369-b382ebe8eeaa admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:12.546105 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa353d0-cada-4122-b7fc-828d55487e56 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:12.546105 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4fa353d0-cada-4122-b7fc-828d55487e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:12.554351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a4926-37fa-4a8a-a369-b382ebe8eeaa admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:12.562581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa353d0-cada-4122-b7fc-828d55487e56 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:12.569012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:12.571173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:12.571173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:12.572098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] PATH_INFO: `/v3/projects/1183b409c6b0483c9c415bdc4f78c94f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:12.572219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d17039-bcaf-432d-bee4-a291c54fb9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:12.572947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17039-bcaf-432d-bee4-a291c54fb9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:12.573239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17039-bcaf-432d-bee4-a291c54fb9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:12.573631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17039-bcaf-432d-bee4-a291c54fb9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:12.574556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d17039-bcaf-432d-bee4-a291c54fb9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:12.576083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d17039-bcaf-432d-bee4-a291c54fb9b8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:12.580639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] RBAC: Authorizing `identity:delete_project(project_id=1183b409c6b0483c9c415bdc4f78c94f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:12.582709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:12.593584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 966/1942] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:12.597719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d17039-bcaf-432d-bee4-a291c54fb9b8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:12.606871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d17039-bcaf-432d-bee4-a291c54fb9b8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:12.611638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eade9a-64de-4cec-8626-b05f21568d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:12.612689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eade9a-64de-4cec-8626-b05f21568d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:12.612984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eade9a-64de-4cec-8626-b05f21568d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:12.613249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eade9a-64de-4cec-8626-b05f21568d21 admin admin] PATH_INFO: `/v3/projects/1d03c8b711ba4067972b7552b58a9b64/users/9aab10a0b7514b7ca9c3ef464f0499cb/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:12.629463 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eade9a-64de-4cec-8626-b05f21568d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d03c8b711ba4067972b7552b58a9b64, user_id=9aab10a0b7514b7ca9c3ef464f0499cb, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:12.632998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eade9a-64de-4cec-8626-b05f21568d21 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:12.734705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 967/1943] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:12 2022] PUT /identity/v3/projects/1d03c8b711ba4067972b7552b58a9b64/users/9aab10a0b7514b7ca9c3ef464f0499cb/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:12.745751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a989-3297-4bd9-ae90-e71e90db5980 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:12.751241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a989-3297-4bd9-ae90-e71e90db5980 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:12.751241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e388a989-3297-4bd9-ae90-e71e90db5980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:12.751461 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1183b409c6b0483c9c415bdc4f78c94f', 'request_id': 'req-5ce64a79-cb38-45a3-b753-ec95cf0079da'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:12.756169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1183b409c6b0483c9c415bdc4f78c94f', 'request_id': 'req-5ce64a79-cb38-45a3-b753-ec95cf0079da'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:12.766005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1183b409c6b0483c9c415bdc4f78c94f', 'request_id': 'req-5ce64a79-cb38-45a3-b753-ec95cf0079da'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:12.777161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e388a989-3297-4bd9-ae90-e71e90db5980 None None] MFA Rules not processed for user `9aab10a0b7514b7ca9c3ef464f0499cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:12.782106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e388a989-3297-4bd9-ae90-e71e90db5980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:12.850968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 968/1944] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:12.857251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388a989-3297-4bd9-ae90-e71e90db5980 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:12.861129 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] The token cache is being invalidate because project 1183b409c6b0483c9c415bdc4f78c94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:12.861496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:12.870452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ce64a79-cb38-45a3-b753-ec95cf0079da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:12.870452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 977/1945] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:12 2022] DELETE /identity/v3/projects/1183b409c6b0483c9c415bdc4f78c94f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:12.872181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ceb6-eb8a-4bca-9aa5-6308bc5d3afe None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:12.872563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ceb6-eb8a-4bca-9aa5-6308bc5d3afe None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:12.872911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ceb6-eb8a-4bca-9aa5-6308bc5d3afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:12.892103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-bdc4ceb6-eb8a-4bca-9aa5-6308bc5d3afe None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:12.893464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bdc4ceb6-eb8a-4bca-9aa5-6308bc5d3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:12.927621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e388a989-3297-4bd9-ae90-e71e90db5980 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:12.935156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3899b-56af-4e82-8f85-3189a083aacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:12.935156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3899b-56af-4e82-8f85-3189a083aacb admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:12.935156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3899b-56af-4e82-8f85-3189a083aacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:12.935760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3899b-56af-4e82-8f85-3189a083aacb admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:12.936924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3899b-56af-4e82-8f85-3189a083aacb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:12.939041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3899b-56af-4e82-8f85-3189a083aacb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:12.973625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 978/1946] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:12.975566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ceb6-eb8a-4bca-9aa5-6308bc5d3afe None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:12.977071 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bdc4ceb6-eb8a-4bca-9aa5-6308bc5d3afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:12.989393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ceb6-eb8a-4bca-9aa5-6308bc5d3afe None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:12.994420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:12.995329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:12.995616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:12.995897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] PATH_INFO: `/v3/projects/df2970428f484b01b583ce6028758fd5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:12.997103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df2970428f484b01b583ce6028758fd5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:12.999068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.015025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 969/1947] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:12 2022] POST /identity/v3/projects => generated 401 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:13.019502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04d0bc-6916-47db-8104-e2f7ea751c1f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.019794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04d0bc-6916-47db-8104-e2f7ea751c1f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.020072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04d0bc-6916-47db-8104-e2f7ea751c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.038479 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7c04d0bc-6916-47db-8104-e2f7ea751c1f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:13.040268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7c04d0bc-6916-47db-8104-e2f7ea751c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:13.094857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:13.107201 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 970/1948] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:13.114023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04d0bc-6916-47db-8104-e2f7ea751c1f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.114023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7c04d0bc-6916-47db-8104-e2f7ea751c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:13.114947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df2970428f484b01b583ce6028758fd5', 'request_id': 'req-c7efc191-8c05-4ca5-9daf-fc296fe14238'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:13.121272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df2970428f484b01b583ce6028758fd5', 'request_id': 'req-c7efc191-8c05-4ca5-9daf-fc296fe14238'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:13.128043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df2970428f484b01b583ce6028758fd5', 'request_id': 'req-c7efc191-8c05-4ca5-9daf-fc296fe14238'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:13.131864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04d0bc-6916-47db-8104-e2f7ea751c1f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.192836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb74970-f771-4847-ab3b-6e1c118f4ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.193543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74970-f771-4847-ab3b-6e1c118f4ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.193826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74970-f771-4847-ab3b-6e1c118f4ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.194163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb74970-f771-4847-ab3b-6e1c118f4ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.195375 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb74970-f771-4847-ab3b-6e1c118f4ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.197740 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb74970-f771-4847-ab3b-6e1c118f4ae8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.203742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] The token cache is being invalidate because project df2970428f484b01b583ce6028758fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:13.204042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:13.204747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:13.206360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 979/1949] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:12 2022] DELETE /identity/v3/projects/df2970428f484b01b583ce6028758fd5 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:13.207478 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.211232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:13.223981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7efc191-8c05-4ca5-9daf-fc296fe14238 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.229264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a692f37-de55-4b5a-a0fa-2ab2cce43861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.229954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a692f37-de55-4b5a-a0fa-2ab2cce43861 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.230245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a692f37-de55-4b5a-a0fa-2ab2cce43861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.230526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a692f37-de55-4b5a-a0fa-2ab2cce43861 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.231249 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a692f37-de55-4b5a-a0fa-2ab2cce43861 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:13.231558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a692f37-de55-4b5a-a0fa-2ab2cce43861 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.233247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a692f37-de55-4b5a-a0fa-2ab2cce43861 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.245245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 980/1950] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:13.246565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f29f3-37d2-45da-9974-5461dd1ff7ed None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.246858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f29f3-37d2-45da-9974-5461dd1ff7ed None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.247144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f29f3-37d2-45da-9974-5461dd1ff7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.267222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e18f29f3-37d2-45da-9974-5461dd1ff7ed None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:13.269958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e18f29f3-37d2-45da-9974-5461dd1ff7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:13.280152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 981/1951] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:13.281126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f29f3-37d2-45da-9974-5461dd1ff7ed None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.291231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f29f3-37d2-45da-9974-5461dd1ff7ed None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.296054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f245fd9-a3dc-48c1-b183-856e356ff50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.296727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245fd9-a3dc-48c1-b183-856e356ff50d admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.297015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245fd9-a3dc-48c1-b183-856e356ff50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.297297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f245fd9-a3dc-48c1-b183-856e356ff50d admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.298187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f245fd9-a3dc-48c1-b183-856e356ff50d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.300114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f245fd9-a3dc-48c1-b183-856e356ff50d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.319863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 971/1952] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:13 2022] POST /identity/v3/users => generated 307 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:13.319863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9a623-ffb4-4218-a16a-79fa46c0a12e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.319863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9a623-ffb4-4218-a16a-79fa46c0a12e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.319863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9a623-ffb4-4218-a16a-79fa46c0a12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.343473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-24c9a623-ffb4-4218-a16a-79fa46c0a12e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:13.343473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-24c9a623-ffb4-4218-a16a-79fa46c0a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:13.347801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 972/1953] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:13.348623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9a623-ffb4-4218-a16a-79fa46c0a12e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.350065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-24c9a623-ffb4-4218-a16a-79fa46c0a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:13.362254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9a623-ffb4-4218-a16a-79fa46c0a12e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.367519 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db793-1572-4efd-8fdd-ff9a14097ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.368205 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db793-1572-4efd-8fdd-ff9a14097ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.372374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db793-1572-4efd-8fdd-ff9a14097ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.372374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8db793-1572-4efd-8fdd-ff9a14097ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.372374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8db793-1572-4efd-8fdd-ff9a14097ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.372374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8db793-1572-4efd-8fdd-ff9a14097ab8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.385637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 973/1954] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:13.385637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db793-1572-4efd-8fdd-ff9a14097ab8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.393936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8db793-1572-4efd-8fdd-ff9a14097ab8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.402688 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 982/1955] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:13 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:13.402888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1932c8-504d-4233-be4c-adf998648800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.402998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f245fd9-a3dc-48c1-b183-856e356ff50d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.403087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1932c8-504d-4233-be4c-adf998648800 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.403087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1932c8-504d-4233-be4c-adf998648800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.403087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1932c8-504d-4233-be4c-adf998648800 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.403087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1932c8-504d-4233-be4c-adf998648800 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:13.403087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1932c8-504d-4233-be4c-adf998648800 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.403937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1932c8-504d-4233-be4c-adf998648800 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.416866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 974/1956] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:13.417554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1932c8-504d-4233-be4c-adf998648800 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.427963 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1932c8-504d-4233-be4c-adf998648800 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.467835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f245fd9-a3dc-48c1-b183-856e356ff50d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.474211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c64d2-2695-4bdf-8e1e-0e1dc91b70a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.474574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c64d2-2695-4bdf-8e1e-0e1dc91b70a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.474863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c64d2-2695-4bdf-8e1e-0e1dc91b70a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.475545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c64d2-2695-4bdf-8e1e-0e1dc91b70a3 admin admin] PATH_INFO: `/v3/projects/2188d352252c46dca156f5f137f2c7c7/users/8e75999f87f64719b701246fe1302aab/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.493910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c64d2-2695-4bdf-8e1e-0e1dc91b70a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2188d352252c46dca156f5f137f2c7c7, user_id=8e75999f87f64719b701246fe1302aab, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.496856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c64d2-2695-4bdf-8e1e-0e1dc91b70a3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.501140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae94b9-f48b-401b-b263-a50294a1bba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.501906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae94b9-f48b-401b-b263-a50294a1bba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.502323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae94b9-f48b-401b-b263-a50294a1bba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.502523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae94b9-f48b-401b-b263-a50294a1bba8 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.503317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae94b9-f48b-401b-b263-a50294a1bba8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.506725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae94b9-f48b-401b-b263-a50294a1bba8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.512487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:13.591778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 983/1957] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:13 2022] PUT /identity/v3/projects/2188d352252c46dca156f5f137f2c7c7/users/8e75999f87f64719b701246fe1302aab/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:13.593124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c64d2-2695-4bdf-8e1e-0e1dc91b70a3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.625799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 975/1958] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:13 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:13.627010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae94b9-f48b-401b-b263-a50294a1bba8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.646610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae94b9-f48b-401b-b263-a50294a1bba8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.677700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c64d2-2695-4bdf-8e1e-0e1dc91b70a3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.684499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4049af-3d95-4638-992d-7c669fe544fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.687640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4049af-3d95-4638-992d-7c669fe544fd admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.687640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4049af-3d95-4638-992d-7c669fe544fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.687640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4049af-3d95-4638-992d-7c669fe544fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.687640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4049af-3d95-4638-992d-7c669fe544fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.688436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4049af-3d95-4638-992d-7c669fe544fd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.704542 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d431620-da8f-4c87-9b18-64f7d653321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.705254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d431620-da8f-4c87-9b18-64f7d653321c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.705858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d431620-da8f-4c87-9b18-64f7d653321c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.706149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d431620-da8f-4c87-9b18-64f7d653321c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.706881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d431620-da8f-4c87-9b18-64f7d653321c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.708494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d431620-da8f-4c87-9b18-64f7d653321c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.719473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 976/1959] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:13.720650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d431620-da8f-4c87-9b18-64f7d653321c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.731312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d431620-da8f-4c87-9b18-64f7d653321c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.738698 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01cc55-8bd9-49ae-8910-c860ff8d063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.739392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01cc55-8bd9-49ae-8910-c860ff8d063b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.739677 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01cc55-8bd9-49ae-8910-c860ff8d063b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.739958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01cc55-8bd9-49ae-8910-c860ff8d063b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.740746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01cc55-8bd9-49ae-8910-c860ff8d063b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.742875 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01cc55-8bd9-49ae-8910-c860ff8d063b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.753556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 977/1960] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:13.756566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01cc55-8bd9-49ae-8910-c860ff8d063b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.765115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01cc55-8bd9-49ae-8910-c860ff8d063b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.769836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb98dd2-87ac-4e95-adfb-784ddea2e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.770756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb98dd2-87ac-4e95-adfb-784ddea2e5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.771058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb98dd2-87ac-4e95-adfb-784ddea2e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.771320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb98dd2-87ac-4e95-adfb-784ddea2e5ad admin admin] PATH_INFO: `/v3/projects/2188d352252c46dca156f5f137f2c7c7/users/8e75999f87f64719b701246fe1302aab/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.773339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb98dd2-87ac-4e95-adfb-784ddea2e5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=2188d352252c46dca156f5f137f2c7c7, user_id=8e75999f87f64719b701246fe1302aab, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.776185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb98dd2-87ac-4e95-adfb-784ddea2e5ad admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.784239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 984/1961] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:13 2022] POST /identity/v3/projects => generated 359 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:13.784239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4049af-3d95-4638-992d-7c669fe544fd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.788214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 978/1962] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:13 2022] PUT /identity/v3/projects/2188d352252c46dca156f5f137f2c7c7/users/8e75999f87f64719b701246fe1302aab/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:13.789175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb98dd2-87ac-4e95-adfb-784ddea2e5ad admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.859273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb98dd2-87ac-4e95-adfb-784ddea2e5ad admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.864735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b462-73df-4475-a2cd-c074ded10036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.871250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b462-73df-4475-a2cd-c074ded10036 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.871250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b462-73df-4475-a2cd-c074ded10036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.871250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b266b462-73df-4475-a2cd-c074ded10036 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.871610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4049af-3d95-4638-992d-7c669fe544fd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:13.871711 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266b462-73df-4475-a2cd-c074ded10036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.871711 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b266b462-73df-4475-a2cd-c074ded10036 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.872824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c3f43-2873-4849-b2f2-046251955c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:13.873743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c3f43-2873-4849-b2f2-046251955c68 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.874034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c3f43-2873-4849-b2f2-046251955c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.874354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c3f43-2873-4849-b2f2-046251955c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.875091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c3f43-2873-4849-b2f2-046251955c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:13.876777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c3f43-2873-4849-b2f2-046251955c68 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:13.887491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 985/1963] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:13.889012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fa80a-24c1-4b4a-aaa1-3c4568cfa0e7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:13.889313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fa80a-24c1-4b4a-aaa1-3c4568cfa0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:13.889692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2fa80a-24c1-4b4a-aaa1-3c4568cfa0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:13.919124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5b2fa80a-24c1-4b4a-aaa1-3c4568cfa0e7 None None] MFA Rules not processed for user `8e75999f87f64719b701246fe1302aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:13.920615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5b2fa80a-24c1-4b4a-aaa1-3c4568cfa0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:13.989017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 979/1964] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:13 2022] POST /identity/v3/users => generated 280 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:13.989017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b462-73df-4475-a2cd-c074ded10036 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:13.997392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b266b462-73df-4475-a2cd-c074ded10036 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.002353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c8d3a-aae4-4eb3-bce1-5e07d52dc3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.003298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c8d3a-aae4-4eb3-bce1-5e07d52dc3e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.003584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c8d3a-aae4-4eb3-bce1-5e07d52dc3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.003918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c8d3a-aae4-4eb3-bce1-5e07d52dc3e7 admin admin] PATH_INFO: `/v3/projects/1cc8c133b87244ff8007912470ec7250/users/7cb9f20ecdb24e48a449af1c2ba67bb7/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.014231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 986/1965] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:13 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:14.015212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fa80a-24c1-4b4a-aaa1-3c4568cfa0e7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.025208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c8d3a-aae4-4eb3-bce1-5e07d52dc3e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc8c133b87244ff8007912470ec7250, user_id=7cb9f20ecdb24e48a449af1c2ba67bb7, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.028132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c8d3a-aae4-4eb3-bce1-5e07d52dc3e7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.028599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2fa80a-24c1-4b4a-aaa1-3c4568cfa0e7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.033492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72444519-c9ff-48c9-a6e4-4c1a74034e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.035096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444519-c9ff-48c9-a6e4-4c1a74034e95 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.035096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444519-c9ff-48c9-a6e4-4c1a74034e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.035096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72444519-c9ff-48c9-a6e4-4c1a74034e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.035480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72444519-c9ff-48c9-a6e4-4c1a74034e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.037107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72444519-c9ff-48c9-a6e4-4c1a74034e95 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.052678 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 987/1966] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:14.052678 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72444519-c9ff-48c9-a6e4-4c1a74034e95 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.052678 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-72444519-c9ff-48c9-a6e4-4c1a74034e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:14.111017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72444519-c9ff-48c9-a6e4-4c1a74034e95 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.115132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a812-b417-4f6e-88da-5c2609e89fa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.115835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a812-b417-4f6e-88da-5c2609e89fa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.116117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a812-b417-4f6e-88da-5c2609e89fa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.116391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8a812-b417-4f6e-88da-5c2609e89fa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.127113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8a812-b417-4f6e-88da-5c2609e89fa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.128630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8a812-b417-4f6e-88da-5c2609e89fa6 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.138743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 988/1967] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:14 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:14.140528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a812-b417-4f6e-88da-5c2609e89fa6 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.159034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 980/1968] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:13 2022] PUT /identity/v3/projects/1cc8c133b87244ff8007912470ec7250/users/7cb9f20ecdb24e48a449af1c2ba67bb7/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:14.159142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8a812-b417-4f6e-88da-5c2609e89fa6 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.161076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669c496-ded6-4b6d-b59a-7ace7692a82d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.161537 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669c496-ded6-4b6d-b59a-7ace7692a82d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.161856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669c496-ded6-4b6d-b59a-7ace7692a82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.189588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7669c496-ded6-4b6d-b59a-7ace7692a82d None None] MFA Rules not processed for user `7cb9f20ecdb24e48a449af1c2ba67bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:14.190890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7669c496-ded6-4b6d-b59a-7ace7692a82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:14.214327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929cd53-b7b8-4959-b0e3-7cc2dcb5d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.215301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929cd53-b7b8-4959-b0e3-7cc2dcb5d865 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.215593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929cd53-b7b8-4959-b0e3-7cc2dcb5d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.215880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e929cd53-b7b8-4959-b0e3-7cc2dcb5d865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.216588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929cd53-b7b8-4959-b0e3-7cc2dcb5d865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.218350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e929cd53-b7b8-4959-b0e3-7cc2dcb5d865 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.229170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 989/1969] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:14.233343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929cd53-b7b8-4959-b0e3-7cc2dcb5d865 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.242786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e929cd53-b7b8-4959-b0e3-7cc2dcb5d865 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.247484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a1695-6e70-45ce-8a4e-5e18eb048f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.248369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a1695-6e70-45ce-8a4e-5e18eb048f05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.248649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a1695-6e70-45ce-8a4e-5e18eb048f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.248925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a1695-6e70-45ce-8a4e-5e18eb048f05 admin admin] PATH_INFO: `/v3/projects/0d1a5deb06464073b0c0b3225e6c9926/users/a6f750542ce040b9a98b3d63b29fb887/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.258678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 981/1970] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:14.263252 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669c496-ded6-4b6d-b59a-7ace7692a82d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.264760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a1695-6e70-45ce-8a4e-5e18eb048f05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d1a5deb06464073b0c0b3225e6c9926, user_id=a6f750542ce040b9a98b3d63b29fb887, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.267664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a1695-6e70-45ce-8a4e-5e18eb048f05 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.274688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669c496-ded6-4b6d-b59a-7ace7692a82d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.282610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfc74f-8d8c-4217-8444-19e9ba8c1c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.282610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfc74f-8d8c-4217-8444-19e9ba8c1c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.282610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfc74f-8d8c-4217-8444-19e9ba8c1c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.282610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfc74f-8d8c-4217-8444-19e9ba8c1c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.282948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfc74f-8d8c-4217-8444-19e9ba8c1c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.283348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfc74f-8d8c-4217-8444-19e9ba8c1c36 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.370137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 990/1971] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:14 2022] PUT /identity/v3/projects/0d1a5deb06464073b0c0b3225e6c9926/users/a6f750542ce040b9a98b3d63b29fb887/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:14.380426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ee3a5-fcd1-4c4b-8685-dd347f971913 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.380647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ee3a5-fcd1-4c4b-8685-dd347f971913 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.380925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25ee3a5-fcd1-4c4b-8685-dd347f971913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.395065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 982/1972] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:14 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:14.399485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfc74f-8d8c-4217-8444-19e9ba8c1c36 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.418200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b25ee3a5-fcd1-4c4b-8685-dd347f971913 None None] MFA Rules not processed for user `a6f750542ce040b9a98b3d63b29fb887`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:14.419519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b25ee3a5-fcd1-4c4b-8685-dd347f971913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:14.465765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfc74f-8d8c-4217-8444-19e9ba8c1c36 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.470541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017f3a3-8fb1-47e3-99f3-a820a0215573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.471272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017f3a3-8fb1-47e3-99f3-a820a0215573 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.471789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017f3a3-8fb1-47e3-99f3-a820a0215573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.471922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1017f3a3-8fb1-47e3-99f3-a820a0215573 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.472587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017f3a3-8fb1-47e3-99f3-a820a0215573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.474566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1017f3a3-8fb1-47e3-99f3-a820a0215573 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.483019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 991/1973] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:14 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:14.483862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ee3a5-fcd1-4c4b-8685-dd347f971913 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.538224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25ee3a5-fcd1-4c4b-8685-dd347f971913 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.542426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d107d2-1052-46a4-84b2-302adbf6eaa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.543080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d107d2-1052-46a4-84b2-302adbf6eaa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.543366 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d107d2-1052-46a4-84b2-302adbf6eaa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.543709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d107d2-1052-46a4-84b2-302adbf6eaa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.545509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e4d107d2-1052-46a4-84b2-302adbf6eaa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:14.602317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d107d2-1052-46a4-84b2-302adbf6eaa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.603765 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d107d2-1052-46a4-84b2-302adbf6eaa6 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.612821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 992/1974] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:14 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:14.614295 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d107d2-1052-46a4-84b2-302adbf6eaa6 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.615072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e4d107d2-1052-46a4-84b2-302adbf6eaa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:14.627040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d107d2-1052-46a4-84b2-302adbf6eaa6 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.631373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca90ae0-c7c5-449b-9718-f5e13f444f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.632199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca90ae0-c7c5-449b-9718-f5e13f444f82 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.633157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca90ae0-c7c5-449b-9718-f5e13f444f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.633600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca90ae0-c7c5-449b-9718-f5e13f444f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.640309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 983/1975] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:14 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:14.645007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017f3a3-8fb1-47e3-99f3-a820a0215573 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.649702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca90ae0-c7c5-449b-9718-f5e13f444f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.650676 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca90ae0-c7c5-449b-9718-f5e13f444f82 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.657505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1017f3a3-8fb1-47e3-99f3-a820a0215573 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.664662 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 993/1976] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:14 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:14.665797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720378cb-c8c7-4c16-b489-f9e4cf15eb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.665797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720378cb-c8c7-4c16-b489-f9e4cf15eb48 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.665797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720378cb-c8c7-4c16-b489-f9e4cf15eb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.666273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720378cb-c8c7-4c16-b489-f9e4cf15eb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.666741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720378cb-c8c7-4c16-b489-f9e4cf15eb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.668379 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720378cb-c8c7-4c16-b489-f9e4cf15eb48 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.688839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 984/1977] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:14.688839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720378cb-c8c7-4c16-b489-f9e4cf15eb48 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.689541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca90ae0-c7c5-449b-9718-f5e13f444f82 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.700190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720378cb-c8c7-4c16-b489-f9e4cf15eb48 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.711676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.711676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.711676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.711676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] PATH_INFO: `/v3/users/a6f750542ce040b9a98b3d63b29fb887` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.712511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f750542ce040b9a98b3d63b29fb887)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.713719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca90ae0-c7c5-449b-9718-f5e13f444f82 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.714532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.723585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c47fa-5eb7-4483-8694-d016e314165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.725747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c47fa-5eb7-4483-8694-d016e314165d admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.726393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c47fa-5eb7-4483-8694-d016e314165d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.727143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c47fa-5eb7-4483-8694-d016e314165d admin admin] PATH_INFO: `/v3/projects/fdf3043542884d63b03a265dd4c71e75/users/510d89f39dbd41f1be1e662e1331e6f4/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.763611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c47fa-5eb7-4483-8694-d016e314165d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf3043542884d63b03a265dd4c71e75, user_id=510d89f39dbd41f1be1e662e1331e6f4, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.768780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89c47fa-5eb7-4483-8694-d016e314165d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.891453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:14.892301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 994/1978] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:14 2022] PUT /identity/v3/projects/fdf3043542884d63b03a265dd4c71e75/users/510d89f39dbd41f1be1e662e1331e6f4/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:14.896152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c47fa-5eb7-4483-8694-d016e314165d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.958374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c47fa-5eb7-4483-8694-d016e314165d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:14.964094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3267c0-044e-447a-9711-32d40d6e5986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:14.964837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3267c0-044e-447a-9711-32d40d6e5986 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:14.965128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3267c0-044e-447a-9711-32d40d6e5986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:14.965412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3267c0-044e-447a-9711-32d40d6e5986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:14.966178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3267c0-044e-447a-9711-32d40d6e5986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:14.967803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3267c0-044e-447a-9711-32d40d6e5986 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:14.979354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 995/1979] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:14.983461 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3267c0-044e-447a-9711-32d40d6e5986 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:14.995388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3267c0-044e-447a-9711-32d40d6e5986 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:15.000830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72360082-aa75-4fe2-bf0f-0fe54cb60f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:15.001778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360082-aa75-4fe2-bf0f-0fe54cb60f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:15.002073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360082-aa75-4fe2-bf0f-0fe54cb60f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:15.002353 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72360082-aa75-4fe2-bf0f-0fe54cb60f42 admin admin] PATH_INFO: `/v3/projects/fdf3043542884d63b03a265dd4c71e75/users/510d89f39dbd41f1be1e662e1331e6f4/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:15.004551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72360082-aa75-4fe2-bf0f-0fe54cb60f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf3043542884d63b03a265dd4c71e75, user_id=510d89f39dbd41f1be1e662e1331e6f4, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:15.007269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72360082-aa75-4fe2-bf0f-0fe54cb60f42 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:15.018803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 996/1980] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:14 2022] PUT /identity/v3/projects/fdf3043542884d63b03a265dd4c71e75/users/510d89f39dbd41f1be1e662e1331e6f4/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:15.034049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6223a-6751-481d-893e-199672dc926d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:15.034344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6223a-6751-481d-893e-199672dc926d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:15.034629 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea6223a-6751-481d-893e-199672dc926d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:15.070891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5ea6223a-6751-481d-893e-199672dc926d None None] MFA Rules not processed for user `510d89f39dbd41f1be1e662e1331e6f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:15.070891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5ea6223a-6751-481d-893e-199672dc926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:15.072681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f750542ce040b9a98b3d63b29fb887'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:15.137181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 997/1981] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:15.147985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6223a-6751-481d-893e-199672dc926d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:15.202713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea6223a-6751-481d-893e-199672dc926d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:15.206660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca2a33-92aa-4b7b-a80a-64a7831591ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:15.207312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca2a33-92aa-4b7b-a80a-64a7831591ba service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:15.207600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca2a33-92aa-4b7b-a80a-64a7831591ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:15.207876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca2a33-92aa-4b7b-a80a-64a7831591ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:15.217822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca2a33-92aa-4b7b-a80a-64a7831591ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:15.219260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca2a33-92aa-4b7b-a80a-64a7831591ba service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:15.229226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 998/1982] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:15.289733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f750542ce040b9a98b3d63b29fb887'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:15.290386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f750542ce040b9a98b3d63b29fb887'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:15.291015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f750542ce040b9a98b3d63b29fb887'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:15.303547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f750542ce040b9a98b3d63b29fb887'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:15.316349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 985/1983] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:14 2022] DELETE /identity/v3/users/a6f750542ce040b9a98b3d63b29fb887 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:15.321692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b2878-e131-4229-a089-6ac230f7bea0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:15.329104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b2878-e131-4229-a089-6ac230f7bea0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:15.329104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4b2878-e131-4229-a089-6ac230f7bea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:15.339786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7f4b2878-e131-4229-a089-6ac230f7bea0 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:15.341042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7f4b2878-e131-4229-a089-6ac230f7bea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:15.404092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 999/1984] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:15.412244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:15.414203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:15.498389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6684d7c2-2e8f-478f-b338-8ee05ce55b30 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:15.498389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f715-e12a-4435-b35d-84aa9e1a8000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:15.498389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f715-e12a-4435-b35d-84aa9e1a8000 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:15.498389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f715-e12a-4435-b35d-84aa9e1a8000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:15.498716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5f715-e12a-4435-b35d-84aa9e1a8000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:15.498716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f715-e12a-4435-b35d-84aa9e1a8000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:15.498716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5f715-e12a-4435-b35d-84aa9e1a8000 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:15.500894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 986/1985] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:15.644271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:15.892936 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b2878-e131-4229-a089-6ac230f7bea0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:15.896764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7f4b2878-e131-4229-a089-6ac230f7bea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:15.906406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4b2878-e131-4229-a089-6ac230f7bea0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:15.911677 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:15.912547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:15.912889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:15.913172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] PATH_INFO: `/v3/users/7cb9f20ecdb24e48a449af1c2ba67bb7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:15.915027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb9f20ecdb24e48a449af1c2ba67bb7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:15.916950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:15.966011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f715-e12a-4435-b35d-84aa9e1a8000 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:15.967357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8de5f715-e12a-4435-b35d-84aa9e1a8000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:15.981096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5f715-e12a-4435-b35d-84aa9e1a8000 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:15.985910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:15.986788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:15.987086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:15.987419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] PATH_INFO: `/v3/projects/0d1a5deb06464073b0c0b3225e6c9926` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:15.988717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d1a5deb06464073b0c0b3225e6c9926)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:15.990668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:16.220586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb9f20ecdb24e48a449af1c2ba67bb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:16.221206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d1a5deb06464073b0c0b3225e6c9926', 'request_id': 'req-a7728d76-0c31-4473-a636-58fb970426b3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:16.221647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb9f20ecdb24e48a449af1c2ba67bb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:16.227309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d1a5deb06464073b0c0b3225e6c9926', 'request_id': 'req-a7728d76-0c31-4473-a636-58fb970426b3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:16.233603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d1a5deb06464073b0c0b3225e6c9926', 'request_id': 'req-a7728d76-0c31-4473-a636-58fb970426b3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:16.305426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb9f20ecdb24e48a449af1c2ba67bb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:16.306086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb9f20ecdb24e48a449af1c2ba67bb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:16.318658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-aed8abd0-1fcc-49dc-8734-4f64ef3bf833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb9f20ecdb24e48a449af1c2ba67bb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:16.331211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1000/1986] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:15 2022] DELETE /identity/v3/users/7cb9f20ecdb24e48a449af1c2ba67bb7 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:16.335618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e26e1e-089d-4a2c-85f0-0180112ac482 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:16.336410 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e26e1e-089d-4a2c-85f0-0180112ac482 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:16.336692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e26e1e-089d-4a2c-85f0-0180112ac482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:16.353659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d4e26e1e-089d-4a2c-85f0-0180112ac482 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:16.354975 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d4e26e1e-089d-4a2c-85f0-0180112ac482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:16.409294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] The token cache is being invalidate because project 0d1a5deb06464073b0c0b3225e6c9926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:16.410170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:16.410665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7728d76-0c31-4473-a636-58fb970426b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:16.412727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 987/1987] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:15 2022] DELETE /identity/v3/projects/0d1a5deb06464073b0c0b3225e6c9926 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:16.418614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f577416-55c2-4fd7-a2ba-a53fce6b7087 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:16.419120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f577416-55c2-4fd7-a2ba-a53fce6b7087 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:16.419702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f577416-55c2-4fd7-a2ba-a53fce6b7087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:16.420630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1001/1988] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:16.438329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e26e1e-089d-4a2c-85f0-0180112ac482 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:16.438998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7f577416-55c2-4fd7-a2ba-a53fce6b7087 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:16.439707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d4e26e1e-089d-4a2c-85f0-0180112ac482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:16.440196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7f577416-55c2-4fd7-a2ba-a53fce6b7087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:16.449207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 988/1989] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:16.457197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1195-8460-4a82-a85f-9e0f94e7111a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:16.457480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1195-8460-4a82-a85f-9e0f94e7111a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:16.457792 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc1195-8460-4a82-a85f-9e0f94e7111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:16.474184 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:16.476982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d6dc1195-8460-4a82-a85f-9e0f94e7111a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:16.478222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d6dc1195-8460-4a82-a85f-9e0f94e7111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:16.487271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 989/1990] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:16.492272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc1195-8460-4a82-a85f-9e0f94e7111a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:16.501908 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc1195-8460-4a82-a85f-9e0f94e7111a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:16.504733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e26e1e-089d-4a2c-85f0-0180112ac482 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:16.506621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f0969-8d86-4b64-8d6d-9ebe5274389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:16.507318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f0969-8d86-4b64-8d6d-9ebe5274389b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:16.508147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f0969-8d86-4b64-8d6d-9ebe5274389b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:16.508427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f0969-8d86-4b64-8d6d-9ebe5274389b admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:16.509162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f0969-8d86-4b64-8d6d-9ebe5274389b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:16.509469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f0969-8d86-4b64-8d6d-9ebe5274389b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:16.509767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b647320-ebeb-4364-b13f-0acad7e31d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:16.510433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647320-ebeb-4364-b13f-0acad7e31d8c service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:16.510817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647320-ebeb-4364-b13f-0acad7e31d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:16.511046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647320-ebeb-4364-b13f-0acad7e31d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:16.511145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f0969-8d86-4b64-8d6d-9ebe5274389b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:16.524070 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b647320-ebeb-4364-b13f-0acad7e31d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:16.528383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 990/1991] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:47:16.528520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b647320-ebeb-4364-b13f-0acad7e31d8c service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:16.529567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f0969-8d86-4b64-8d6d-9ebe5274389b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:16.538227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1002/1992] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:16.541241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f0969-8d86-4b64-8d6d-9ebe5274389b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:16.546349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134ffc3-0033-4eb5-94e9-84f9fdedfdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:16.547039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ffc3-0033-4eb5-94e9-84f9fdedfdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:16.547433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ffc3-0033-4eb5-94e9-84f9fdedfdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:16.547433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ffc3-0033-4eb5-94e9-84f9fdedfdb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:16.549142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134ffc3-0033-4eb5-94e9-84f9fdedfdb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:16.550348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134ffc3-0033-4eb5-94e9-84f9fdedfdb0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:16.642051 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 991/1993] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:16 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:16.646061 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b647320-ebeb-4364-b13f-0acad7e31d8c service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:16.656168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b647320-ebeb-4364-b13f-0acad7e31d8c service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:16.717723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fda41-ccd0-4ed5-a8fd-9317f0d329d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:16.718420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fda41-ccd0-4ed5-a8fd-9317f0d329d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:16.718708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fda41-ccd0-4ed5-a8fd-9317f0d329d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:16.718988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234fda41-ccd0-4ed5-a8fd-9317f0d329d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:16.719686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fda41-ccd0-4ed5-a8fd-9317f0d329d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:16.721635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234fda41-ccd0-4ed5-a8fd-9317f0d329d0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:16.816646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1003/1994] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:16 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:16.821706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134ffc3-0033-4eb5-94e9-84f9fdedfdb0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:16.833566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134ffc3-0033-4eb5-94e9-84f9fdedfdb0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:16.838504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b914254-3431-4bc0-aa6d-8b46fd365f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:16.839269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914254-3431-4bc0-aa6d-8b46fd365f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:16.839624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914254-3431-4bc0-aa6d-8b46fd365f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:16.839975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914254-3431-4bc0-aa6d-8b46fd365f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:16.840903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b914254-3431-4bc0-aa6d-8b46fd365f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:16.842798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b914254-3431-4bc0-aa6d-8b46fd365f68 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:16.854979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 992/1995] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:16.859154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fda41-ccd0-4ed5-a8fd-9317f0d329d0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:16.870131 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234fda41-ccd0-4ed5-a8fd-9317f0d329d0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:16.875125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b27aa-45a1-4d64-b077-925deaf65be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:16.875893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b27aa-45a1-4d64-b077-925deaf65be7 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:16.881241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b27aa-45a1-4d64-b077-925deaf65be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:16.881241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b27aa-45a1-4d64-b077-925deaf65be7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:16.881241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b27aa-45a1-4d64-b077-925deaf65be7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:16.881241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b27aa-45a1-4d64-b077-925deaf65be7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:16.893707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1004/1996] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:16.897919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b914254-3431-4bc0-aa6d-8b46fd365f68 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:16.908421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b914254-3431-4bc0-aa6d-8b46fd365f68 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:16.914518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89305f2d-5bf2-435a-9bfe-35355d5b8aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:16.915630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89305f2d-5bf2-435a-9bfe-35355d5b8aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:16.915760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89305f2d-5bf2-435a-9bfe-35355d5b8aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:16.915946 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89305f2d-5bf2-435a-9bfe-35355d5b8aa4 admin admin] PATH_INFO: `/v3/projects/6340053cd8414a629ce0235571b1a73f/users/21b3e8620e02403aae232548918c69b9/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:16.932066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89305f2d-5bf2-435a-9bfe-35355d5b8aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6340053cd8414a629ce0235571b1a73f, user_id=21b3e8620e02403aae232548918c69b9, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:16.934759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89305f2d-5bf2-435a-9bfe-35355d5b8aa4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:16.986707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b27aa-45a1-4d64-b077-925deaf65be7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:16.986707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6e8b27aa-45a1-4d64-b077-925deaf65be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:17.001476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b27aa-45a1-4d64-b077-925deaf65be7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:17.007807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:17.008913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:17.009309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:17.009681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] PATH_INFO: `/v3/projects/1cc8c133b87244ff8007912470ec7250` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:17.011196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc8c133b87244ff8007912470ec7250)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:17.013611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:17.103342 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 993/1997] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:16 2022] PUT /identity/v3/projects/6340053cd8414a629ce0235571b1a73f/users/21b3e8620e02403aae232548918c69b9/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:17.115110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e85ecc-4300-4d16-8757-1443397fb721 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:17.115307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e85ecc-4300-4d16-8757-1443397fb721 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:17.115529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e85ecc-4300-4d16-8757-1443397fb721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:17.149672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-52e85ecc-4300-4d16-8757-1443397fb721 None None] MFA Rules not processed for user `21b3e8620e02403aae232548918c69b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:17.150968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-52e85ecc-4300-4d16-8757-1443397fb721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:17.237618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 994/1998] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:17.245195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc8c133b87244ff8007912470ec7250', 'request_id': 'req-7e69b963-bbf4-47b9-88b1-93d287680043'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:17.249494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e85ecc-4300-4d16-8757-1443397fb721 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:17.250953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-52e85ecc-4300-4d16-8757-1443397fb721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:17.259731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc8c133b87244ff8007912470ec7250', 'request_id': 'req-7e69b963-bbf4-47b9-88b1-93d287680043'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:17.268985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc8c133b87244ff8007912470ec7250', 'request_id': 'req-7e69b963-bbf4-47b9-88b1-93d287680043'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:17.311121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e85ecc-4300-4d16-8757-1443397fb721 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:17.363253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4e13d-2168-4e5f-9b5a-d90fef8289d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:17.364040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4e13d-2168-4e5f-9b5a-d90fef8289d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:17.371216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] The token cache is being invalidate because project 1cc8c133b87244ff8007912470ec7250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:17.371370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4e13d-2168-4e5f-9b5a-d90fef8289d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:17.371370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4e13d-2168-4e5f-9b5a-d90fef8289d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:17.371549 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:17.371549 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:17.371721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a5c4e13d-2168-4e5f-9b5a-d90fef8289d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:17.371808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1005/1999] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:16 2022] DELETE /identity/v3/projects/1cc8c133b87244ff8007912470ec7250 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:17.371808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:17.373036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:17.435214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4e13d-2168-4e5f-9b5a-d90fef8289d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:17.436677 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4e13d-2168-4e5f-9b5a-d90fef8289d5 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:17.441546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69b963-bbf4-47b9-88b1-93d287680043 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:17.445908 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 995/2000] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:17.446649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:17.447603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:17.447898 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:17.448218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] PATH_INFO: `/v3/users/510d89f39dbd41f1be1e662e1331e6f4` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:17.449511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=510d89f39dbd41f1be1e662e1331e6f4)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:17.451488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:17.646963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510d89f39dbd41f1be1e662e1331e6f4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:17.647631 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510d89f39dbd41f1be1e662e1331e6f4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:17.770490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:17.819576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510d89f39dbd41f1be1e662e1331e6f4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:17.820770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510d89f39dbd41f1be1e662e1331e6f4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:17.836625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cfc10584-6c37-46a8-a71e-e7b9fd8868b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510d89f39dbd41f1be1e662e1331e6f4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:17.849786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1006/2001] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:17 2022] DELETE /identity/v3/users/510d89f39dbd41f1be1e662e1331e6f4 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:18.383221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4e13d-2168-4e5f-9b5a-d90fef8289d5 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:18.395149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4e13d-2168-4e5f-9b5a-d90fef8289d5 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:18.460658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:18.461234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:18.461234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:18.461380 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] PATH_INFO: `/v3/projects/fdf3043542884d63b03a265dd4c71e75` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:18.463914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf3043542884d63b03a265dd4c71e75)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:18.465857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:18.622000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf3043542884d63b03a265dd4c71e75', 'request_id': 'req-a5afbb1b-313a-4e66-b775-e78db56b4238'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:18.627413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf3043542884d63b03a265dd4c71e75', 'request_id': 'req-a5afbb1b-313a-4e66-b775-e78db56b4238'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:18.633689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf3043542884d63b03a265dd4c71e75', 'request_id': 'req-a5afbb1b-313a-4e66-b775-e78db56b4238'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:18.746482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] The token cache is being invalidate because project fdf3043542884d63b03a265dd4c71e75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:18.746784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:18.747424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a5afbb1b-313a-4e66-b775-e78db56b4238 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:18.748999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 996/2002] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:18 2022] DELETE /identity/v3/projects/fdf3043542884d63b03a265dd4c71e75 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:18.754393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bab7e8-39e1-4b4b-9004-0bde30c1a399 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:18.754905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bab7e8-39e1-4b4b-9004-0bde30c1a399 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:18.754996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bab7e8-39e1-4b4b-9004-0bde30c1a399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:18.774985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-83bab7e8-39e1-4b4b-9004-0bde30c1a399 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:18.785418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-83bab7e8-39e1-4b4b-9004-0bde30c1a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:18.838528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1007/2003] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:18.847681 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c16e79-1d85-45ca-a444-f6714dceaea5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:18.848108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c16e79-1d85-45ca-a444-f6714dceaea5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:18.848383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c16e79-1d85-45ca-a444-f6714dceaea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:18.852865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:18.871841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-13c16e79-1d85-45ca-a444-f6714dceaea5 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:18.873192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-13c16e79-1d85-45ca-a444-f6714dceaea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:18.881756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 997/2004] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:18.892437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bab7e8-39e1-4b4b-9004-0bde30c1a399 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:18.905714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bab7e8-39e1-4b4b-9004-0bde30c1a399 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:18.915920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552fce2-2b91-452e-bf6a-8ff465cb7e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:18.923261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552fce2-2b91-452e-bf6a-8ff465cb7e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:18.923261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552fce2-2b91-452e-bf6a-8ff465cb7e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:18.923261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552fce2-2b91-452e-bf6a-8ff465cb7e03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:18.923261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552fce2-2b91-452e-bf6a-8ff465cb7e03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:18.923261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552fce2-2b91-452e-bf6a-8ff465cb7e03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:18.923261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552fce2-2b91-452e-bf6a-8ff465cb7e03 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:18.932294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1008/2005] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:18.936659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c16e79-1d85-45ca-a444-f6714dceaea5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:18.946248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c16e79-1d85-45ca-a444-f6714dceaea5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:18.951157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520708f-278e-48a9-a9be-1ad8b1550932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:18.951896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520708f-278e-48a9-a9be-1ad8b1550932 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:18.952246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520708f-278e-48a9-a9be-1ad8b1550932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:18.952550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7520708f-278e-48a9-a9be-1ad8b1550932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:18.953250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520708f-278e-48a9-a9be-1ad8b1550932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:18.955249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7520708f-278e-48a9-a9be-1ad8b1550932 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:19.061122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 998/2006] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:18 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:19.065908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552fce2-2b91-452e-bf6a-8ff465cb7e03 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:19.077949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552fce2-2b91-452e-bf6a-8ff465cb7e03 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:19.135723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61bb9e-bc96-4f2f-ba84-f7196b138cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:19.136312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61bb9e-bc96-4f2f-ba84-f7196b138cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:19.136600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61bb9e-bc96-4f2f-ba84-f7196b138cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:19.136883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61bb9e-bc96-4f2f-ba84-f7196b138cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:19.137561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61bb9e-bc96-4f2f-ba84-f7196b138cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:19.139530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61bb9e-bc96-4f2f-ba84-f7196b138cf1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:19.305709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1009/2007] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:19 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:19.314849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520708f-278e-48a9-a9be-1ad8b1550932 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:19.325635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7520708f-278e-48a9-a9be-1ad8b1550932 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:19.330851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc04d7-8626-4454-a8cb-8455c8f4b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:19.331551 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc04d7-8626-4454-a8cb-8455c8f4b1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:19.331834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc04d7-8626-4454-a8cb-8455c8f4b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:19.332110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc04d7-8626-4454-a8cb-8455c8f4b1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:19.333051 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc04d7-8626-4454-a8cb-8455c8f4b1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:19.334769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cc04d7-8626-4454-a8cb-8455c8f4b1cc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:19.346662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 999/2008] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:19.353340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61bb9e-bc96-4f2f-ba84-f7196b138cf1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:19.365175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61bb9e-bc96-4f2f-ba84-f7196b138cf1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:19.370162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ba039-e4f8-4c0e-9b43-c8f9abd9f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:19.370865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ba039-e4f8-4c0e-9b43-c8f9abd9f790 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:19.371149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ba039-e4f8-4c0e-9b43-c8f9abd9f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:19.371426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ba039-e4f8-4c0e-9b43-c8f9abd9f790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:19.372176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ba039-e4f8-4c0e-9b43-c8f9abd9f790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:19.374013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ba039-e4f8-4c0e-9b43-c8f9abd9f790 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:19.393148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1010/2009] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:19.395921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc04d7-8626-4454-a8cb-8455c8f4b1cc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:19.411102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc04d7-8626-4454-a8cb-8455c8f4b1cc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:19.418428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f62a9e-138e-4b33-bf68-618b021d0af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:19.419833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f62a9e-138e-4b33-bf68-618b021d0af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:19.420124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f62a9e-138e-4b33-bf68-618b021d0af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:19.420503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f62a9e-138e-4b33-bf68-618b021d0af3 admin admin] PATH_INFO: `/v3/projects/ef60deeda04b4b599a4260ddded84a77/users/1529a10e07fa4bc1803932e58c8575ac/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:19.439786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f62a9e-138e-4b33-bf68-618b021d0af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef60deeda04b4b599a4260ddded84a77, user_id=1529a10e07fa4bc1803932e58c8575ac, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:19.442978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f62a9e-138e-4b33-bf68-618b021d0af3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:19.542335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1000/2010] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:19 2022] PUT /identity/v3/projects/ef60deeda04b4b599a4260ddded84a77/users/1529a10e07fa4bc1803932e58c8575ac/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:19.553774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b47d9-d99f-4088-b85e-4df59d9460e5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:19.553957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b47d9-d99f-4088-b85e-4df59d9460e5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:19.554818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b47d9-d99f-4088-b85e-4df59d9460e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:19.590581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-858b47d9-d99f-4088-b85e-4df59d9460e5 None None] MFA Rules not processed for user `1529a10e07fa4bc1803932e58c8575ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:19.592259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-858b47d9-d99f-4088-b85e-4df59d9460e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:19.699528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1011/2011] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:19.706436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f62a9e-138e-4b33-bf68-618b021d0af3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:19.797127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f62a9e-138e-4b33-bf68-618b021d0af3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:19.802262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee222be2-b5b5-43d8-b485-2bf4937cb538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:19.802938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee222be2-b5b5-43d8-b485-2bf4937cb538 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:19.803228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee222be2-b5b5-43d8-b485-2bf4937cb538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:19.803513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee222be2-b5b5-43d8-b485-2bf4937cb538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:19.804210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee222be2-b5b5-43d8-b485-2bf4937cb538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:19.806160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee222be2-b5b5-43d8-b485-2bf4937cb538 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:19.956390 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1001/2012] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:19 2022] POST /identity/v3/projects => generated 381 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:19.962625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b47d9-d99f-4088-b85e-4df59d9460e5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:19.981952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b47d9-d99f-4088-b85e-4df59d9460e5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:20.057996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5230f-30e1-44b4-a1fd-1b01eee0d311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:20.059253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5230f-30e1-44b4-a1fd-1b01eee0d311 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:20.059762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5230f-30e1-44b4-a1fd-1b01eee0d311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:20.060297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5230f-30e1-44b4-a1fd-1b01eee0d311 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:20.061580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5230f-30e1-44b4-a1fd-1b01eee0d311 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:20.064299 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5230f-30e1-44b4-a1fd-1b01eee0d311 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:20.244114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1012/2013] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:19 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:20.245598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee222be2-b5b5-43d8-b485-2bf4937cb538 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:20.256584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee222be2-b5b5-43d8-b485-2bf4937cb538 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:20.262186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f4832-5a6c-4524-a448-6c5e159ad8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:20.262953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f4832-5a6c-4524-a448-6c5e159ad8a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:20.263238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f4832-5a6c-4524-a448-6c5e159ad8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:20.263519 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f4832-5a6c-4524-a448-6c5e159ad8a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:20.264259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f4832-5a6c-4524-a448-6c5e159ad8a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:20.265876 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f4832-5a6c-4524-a448-6c5e159ad8a0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:20.277379 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1002/2014] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:20.283631 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5230f-30e1-44b4-a1fd-1b01eee0d311 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:20.291530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5230f-30e1-44b4-a1fd-1b01eee0d311 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:20.297127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3f3c-fe44-4c06-be63-3b6cb4052f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:20.298083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3f3c-fe44-4c06-be63-3b6cb4052f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:20.298529 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3f3c-fe44-4c06-be63-3b6cb4052f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:20.298810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff3f3c-fe44-4c06-be63-3b6cb4052f3f admin admin] PATH_INFO: `/v3/projects/d5d2f9972e9e4aa691dd00d7a21c74e3/users/7a8d64e0c3de44c5b9a05d5a23c410a4/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:20.317106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:20.318429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3f3c-fe44-4c06-be63-3b6cb4052f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d2f9972e9e4aa691dd00d7a21c74e3, user_id=7a8d64e0c3de44c5b9a05d5a23c410a4, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:20.322015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff3f3c-fe44-4c06-be63-3b6cb4052f3f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:20.469526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1013/2015] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:20 2022] PUT /identity/v3/projects/d5d2f9972e9e4aa691dd00d7a21c74e3/users/7a8d64e0c3de44c5b9a05d5a23c410a4/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:20.473418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f4832-5a6c-4524-a448-6c5e159ad8a0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:20.483514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f4832-5a6c-4524-a448-6c5e159ad8a0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:20.543054 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081f697-5b96-4eb4-93f1-f3d87873fc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:20.543729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081f697-5b96-4eb4-93f1-f3d87873fc1a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:20.544904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081f697-5b96-4eb4-93f1-f3d87873fc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:20.544904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081f697-5b96-4eb4-93f1-f3d87873fc1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:20.545082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081f697-5b96-4eb4-93f1-f3d87873fc1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:20.546680 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081f697-5b96-4eb4-93f1-f3d87873fc1a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:20.557265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1003/2016] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:20.561617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3f3c-fe44-4c06-be63-3b6cb4052f3f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:20.572640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff3f3c-fe44-4c06-be63-3b6cb4052f3f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:20.577301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8d8e0-e96f-4af4-9860-92f29c0dd63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:20.578247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d8e0-e96f-4af4-9860-92f29c0dd63f admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:20.578532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d8e0-e96f-4af4-9860-92f29c0dd63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:20.578808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8d8e0-e96f-4af4-9860-92f29c0dd63f admin admin] PATH_INFO: `/v3/projects/d5d2f9972e9e4aa691dd00d7a21c74e3/users/7a8d64e0c3de44c5b9a05d5a23c410a4/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:20.580798 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8d8e0-e96f-4af4-9860-92f29c0dd63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d2f9972e9e4aa691dd00d7a21c74e3, user_id=7a8d64e0c3de44c5b9a05d5a23c410a4, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:20.583486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8d8e0-e96f-4af4-9860-92f29c0dd63f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:20.594103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1014/2017] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:20 2022] PUT /identity/v3/projects/d5d2f9972e9e4aa691dd00d7a21c74e3/users/7a8d64e0c3de44c5b9a05d5a23c410a4/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:20.605121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4736cb8-300b-4e3b-81ec-451bedb04210 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:20.605442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4736cb8-300b-4e3b-81ec-451bedb04210 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:20.605713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4736cb8-300b-4e3b-81ec-451bedb04210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:20.642223 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b4736cb8-300b-4e3b-81ec-451bedb04210 None None] MFA Rules not processed for user `7a8d64e0c3de44c5b9a05d5a23c410a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:20.647804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b4736cb8-300b-4e3b-81ec-451bedb04210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:20.749340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1004/2018] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:20.762587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8d8e0-e96f-4af4-9860-92f29c0dd63f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:20.764988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-85e8d8e0-e96f-4af4-9860-92f29c0dd63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:20.832070 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8d8e0-e96f-4af4-9860-92f29c0dd63f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:20.836726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3d5c7-798f-4741-b513-9b32218b9fc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:20.837449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3d5c7-798f-4741-b513-9b32218b9fc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:20.837759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3d5c7-798f-4741-b513-9b32218b9fc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:20.838040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3d5c7-798f-4741-b513-9b32218b9fc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:20.852057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3d5c7-798f-4741-b513-9b32218b9fc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:20.854238 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3d5c7-798f-4741-b513-9b32218b9fc9 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:20.865241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1015/2019] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:21.272504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4736cb8-300b-4e3b-81ec-451bedb04210 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:21.316078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4736cb8-300b-4e3b-81ec-451bedb04210 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:21.332094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29a764-89c1-436d-9d2d-b9c53869385e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:21.336249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29a764-89c1-436d-9d2d-b9c53869385e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:21.339020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29a764-89c1-436d-9d2d-b9c53869385e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:21.340310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29a764-89c1-436d-9d2d-b9c53869385e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:21.347634 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:21.441182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:21.538420 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29a764-89c1-436d-9d2d-b9c53869385e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:21.542255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29a764-89c1-436d-9d2d-b9c53869385e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:21.570571 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1005/2020] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:21.948423 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3d5c7-798f-4741-b513-9b32218b9fc9 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:21.949888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1ef3d5c7-798f-4741-b513-9b32218b9fc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:22.045494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3d5c7-798f-4741-b513-9b32218b9fc9 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:22.050793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:22.051819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:22.052176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:22.052552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] PATH_INFO: `/v3/users/21b3e8620e02403aae232548918c69b9` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:22.053987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b3e8620e02403aae232548918c69b9)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:22.056017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:22.181810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29a764-89c1-436d-9d2d-b9c53869385e service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:22.183281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6d29a764-89c1-436d-9d2d-b9c53869385e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:22.199400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29a764-89c1-436d-9d2d-b9c53869385e service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:22.204888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:22.205894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:22.206494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:22.206913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] PATH_INFO: `/v3/users/9aab10a0b7514b7ca9c3ef464f0499cb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:22.209931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aab10a0b7514b7ca9c3ef464f0499cb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:22.212770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:22.363348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b3e8620e02403aae232548918c69b9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.363348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b3e8620e02403aae232548918c69b9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.490932 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b3e8620e02403aae232548918c69b9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.493564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b3e8620e02403aae232548918c69b9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.510970 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aab10a0b7514b7ca9c3ef464f0499cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.512016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3cccdddd-358b-4f2b-8602-b980d71a6ad2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b3e8620e02403aae232548918c69b9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.530184 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1016/2021] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:21 2022] DELETE /identity/v3/users/21b3e8620e02403aae232548918c69b9 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:22.535044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebb4ca-1c6e-4b81-8ba9-b22f7af4959d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:22.535347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebb4ca-1c6e-4b81-8ba9-b22f7af4959d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:22.535764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ebb4ca-1c6e-4b81-8ba9-b22f7af4959d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:22.563140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-70ebb4ca-1c6e-4b81-8ba9-b22f7af4959d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:22.564372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-70ebb4ca-1c6e-4b81-8ba9-b22f7af4959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:22.634576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1017/2022] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:22.638684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebb4ca-1c6e-4b81-8ba9-b22f7af4959d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:22.640078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-70ebb4ca-1c6e-4b81-8ba9-b22f7af4959d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:22.649532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aab10a0b7514b7ca9c3ef464f0499cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.650512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aab10a0b7514b7ca9c3ef464f0499cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.651273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aab10a0b7514b7ca9c3ef464f0499cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.652189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ebb4ca-1c6e-4b81-8ba9-b22f7af4959d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:22.666906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:22.666906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:22.666906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:22.666906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] PATH_INFO: `/v3/users/1529a10e07fa4bc1803932e58c8575ac` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:22.667235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1529a10e07fa4bc1803932e58c8575ac)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:22.667235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:22.676271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aab10a0b7514b7ca9c3ef464f0499cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.692821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1006/2023] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:22 2022] DELETE /identity/v3/users/9aab10a0b7514b7ca9c3ef464f0499cb => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:22.694219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:22.698471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:22.766256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a287de-6a86-4d65-b1cb-de73f1290799 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:22.770667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de63990-6f6e-43c4-877b-5db09850f690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:22.771326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63990-6f6e-43c4-877b-5db09850f690 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:22.771612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63990-6f6e-43c4-877b-5db09850f690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:22.771889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de63990-6f6e-43c4-877b-5db09850f690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:22.774800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3de63990-6f6e-43c4-877b-5db09850f690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:22.844471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de63990-6f6e-43c4-877b-5db09850f690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:22.845987 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de63990-6f6e-43c4-877b-5db09850f690 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:22.856795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1007/2024] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:22.858326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc36af-bc5d-4c2b-b9a4-e2365ceaafc4 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:22.858626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc36af-bc5d-4c2b-b9a4-e2365ceaafc4 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:22.858974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bc36af-bc5d-4c2b-b9a4-e2365ceaafc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:22.876491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-76bc36af-bc5d-4c2b-b9a4-e2365ceaafc4 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:22.877873 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-76bc36af-bc5d-4c2b-b9a4-e2365ceaafc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:22.885754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1008/2025] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:22.895880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc36af-bc5d-4c2b-b9a4-e2365ceaafc4 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:22.897301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-76bc36af-bc5d-4c2b-b9a4-e2365ceaafc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:22.909627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bc36af-bc5d-4c2b-b9a4-e2365ceaafc4 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:22.914022 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d8aaf3-be54-4079-910e-f741dfb8712c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:22.914694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8aaf3-be54-4079-910e-f741dfb8712c service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:22.914985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8aaf3-be54-4079-910e-f741dfb8712c service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:22.915268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d8aaf3-be54-4079-910e-f741dfb8712c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:22.920136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:22.926013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8aaf3-be54-4079-910e-f741dfb8712c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:22.927468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d8aaf3-be54-4079-910e-f741dfb8712c service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:22.938281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1009/2026] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:22.942371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1529a10e07fa4bc1803932e58c8575ac'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:22.943139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1529a10e07fa4bc1803932e58c8575ac'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.021122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1529a10e07fa4bc1803932e58c8575ac'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.021776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1529a10e07fa4bc1803932e58c8575ac'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.035549 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1529a10e07fa4bc1803932e58c8575ac'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.049462 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1018/2027] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:22 2022] DELETE /identity/v3/users/1529a10e07fa4bc1803932e58c8575ac => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:23.055627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae3965-a1c2-4037-9990-1686c8750299 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:23.056121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae3965-a1c2-4037-9990-1686c8750299 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:23.056607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae3965-a1c2-4037-9990-1686c8750299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:23.082567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f2ae3965-a1c2-4037-9990-1686c8750299 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:23.083833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f2ae3965-a1c2-4037-9990-1686c8750299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:23.175700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1010/2028] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:23.194064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:23.194064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:23.262850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa1704-30ec-47b0-9d15-9f3ade7c4792 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:23.267798 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a34f7-7720-424c-8a79-cba54367bdd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:23.268578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a34f7-7720-424c-8a79-cba54367bdd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:23.268744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a34f7-7720-424c-8a79-cba54367bdd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:23.269311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a34f7-7720-424c-8a79-cba54367bdd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:23.281145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a34f7-7720-424c-8a79-cba54367bdd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:23.282724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a34f7-7720-424c-8a79-cba54367bdd5 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:23.297300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1019/2029] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:23.470133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae3965-a1c2-4037-9990-1686c8750299 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:23.472787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f2ae3965-a1c2-4037-9990-1686c8750299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:23.496371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae3965-a1c2-4037-9990-1686c8750299 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:23.497354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:23.502589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:23.503914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:23.503914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:23.504117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] PATH_INFO: `/v3/projects/6340053cd8414a629ce0235571b1a73f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:23.505696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6340053cd8414a629ce0235571b1a73f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:23.507775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a34f7-7720-424c-8a79-cba54367bdd5 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:23.508565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:23.509731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a49a34f7-7720-424c-8a79-cba54367bdd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:23.533541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a34f7-7720-424c-8a79-cba54367bdd5 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:23.544027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:23.544817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:23.545231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:23.545474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] PATH_INFO: `/v3/projects/1d03c8b711ba4067972b7552b58a9b64` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:23.546819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d03c8b711ba4067972b7552b58a9b64)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:23.548609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:23.655664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6340053cd8414a629ce0235571b1a73f', 'request_id': 'req-ed59cf82-d508-4a3a-9983-58d3ed500e41'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.662286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6340053cd8414a629ce0235571b1a73f', 'request_id': 'req-ed59cf82-d508-4a3a-9983-58d3ed500e41'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.669015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6340053cd8414a629ce0235571b1a73f', 'request_id': 'req-ed59cf82-d508-4a3a-9983-58d3ed500e41'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.717604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d03c8b711ba4067972b7552b58a9b64', 'request_id': 'req-b5a69029-9f0e-485b-be21-74ff74afe819'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.725536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d03c8b711ba4067972b7552b58a9b64', 'request_id': 'req-b5a69029-9f0e-485b-be21-74ff74afe819'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.734314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d03c8b711ba4067972b7552b58a9b64', 'request_id': 'req-b5a69029-9f0e-485b-be21-74ff74afe819'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.765402 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] The token cache is being invalidate because project 6340053cd8414a629ce0235571b1a73f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:23.765732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.766371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ed59cf82-d508-4a3a-9983-58d3ed500e41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.768481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1011/2030] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:23 2022] DELETE /identity/v3/projects/6340053cd8414a629ce0235571b1a73f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:23.773217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6253-5aba-408d-a9bd-d40d5d90f84d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:23.777750 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6253-5aba-408d-a9bd-d40d5d90f84d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:23.777750 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4c6253-5aba-408d-a9bd-d40d5d90f84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:23.802822 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-0f4c6253-5aba-408d-a9bd-d40d5d90f84d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:23.804358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0f4c6253-5aba-408d-a9bd-d40d5d90f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:23.853841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] The token cache is being invalidate because project 1d03c8b711ba4067972b7552b58a9b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:23.854143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.854861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:23.856759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1020/2031] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:23 2022] DELETE /identity/v3/projects/1d03c8b711ba4067972b7552b58a9b64 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:23.857323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:23.861231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:23.892486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1012/2032] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:23.893533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c6253-5aba-408d-a9bd-d40d5d90f84d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:23.894914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0f4c6253-5aba-408d-a9bd-d40d5d90f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:23.919366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4c6253-5aba-408d-a9bd-d40d5d90f84d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:23.925944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:23.926950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:23.927273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:23.927624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] PATH_INFO: `/v3/users/8e75999f87f64719b701246fe1302aab` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:23.929143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e75999f87f64719b701246fe1302aab)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:23.933539 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:23.966222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a69029-9f0e-485b-be21-74ff74afe819 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:23.971298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:23.972159 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:23.972447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:23.972752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] PATH_INFO: `/v3/projects/ef60deeda04b4b599a4260ddded84a77` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:23.974009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef60deeda04b4b599a4260ddded84a77)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:23.976339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.152760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef60deeda04b4b599a4260ddded84a77', 'request_id': 'req-c716ec28-051e-47f4-ab7a-283d242237e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.159297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e75999f87f64719b701246fe1302aab'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.160058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef60deeda04b4b599a4260ddded84a77', 'request_id': 'req-c716ec28-051e-47f4-ab7a-283d242237e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.168525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef60deeda04b4b599a4260ddded84a77', 'request_id': 'req-c716ec28-051e-47f4-ab7a-283d242237e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.290382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e75999f87f64719b701246fe1302aab'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.291311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e75999f87f64719b701246fe1302aab'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.292387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e75999f87f64719b701246fe1302aab'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.317464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cda550ff-dfc8-4911-b0ce-08ea3cabb0bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e75999f87f64719b701246fe1302aab'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.333538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1013/2033] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:23 2022] DELETE /identity/v3/users/8e75999f87f64719b701246fe1302aab => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:24.334957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870ead-8a30-4e7a-9b06-0c5f01d62752 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.335256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870ead-8a30-4e7a-9b06-0c5f01d62752 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.335609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f870ead-8a30-4e7a-9b06-0c5f01d62752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.362496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7f870ead-8a30-4e7a-9b06-0c5f01d62752 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:24.364325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7f870ead-8a30-4e7a-9b06-0c5f01d62752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:24.382567 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] The token cache is being invalidate because project ef60deeda04b4b599a4260ddded84a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:24.382871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.383635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.385754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1021/2034] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:23 2022] DELETE /identity/v3/projects/ef60deeda04b4b599a4260ddded84a77 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:24.392240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.393828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:24.408721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:24.449866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1014/2035] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:24.450892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f870ead-8a30-4e7a-9b06-0c5f01d62752 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.460321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f870ead-8a30-4e7a-9b06-0c5f01d62752 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.465622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b666-afc2-440c-8c5c-bb6b1ca7dd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.466431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b666-afc2-440c-8c5c-bb6b1ca7dd8e admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.466773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b666-afc2-440c-8c5c-bb6b1ca7dd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.471009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b666-afc2-440c-8c5c-bb6b1ca7dd8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.471009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b666-afc2-440c-8c5c-bb6b1ca7dd8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:24.471009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b666-afc2-440c-8c5c-bb6b1ca7dd8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.471009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b666-afc2-440c-8c5c-bb6b1ca7dd8e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.478564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716ec28-051e-47f4-ab7a-283d242237e6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.483821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.483986 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1015/2036] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:24.485037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.485329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.485617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] PATH_INFO: `/v3/users/7a8d64e0c3de44c5b9a05d5a23c410a4` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.487933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a8d64e0c3de44c5b9a05d5a23c410a4)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.488233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b666-afc2-440c-8c5c-bb6b1ca7dd8e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.490772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.501259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b666-afc2-440c-8c5c-bb6b1ca7dd8e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.506552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e67635-a95e-4485-a57a-2e61509c0409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.507467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e67635-a95e-4485-a57a-2e61509c0409 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.507856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e67635-a95e-4485-a57a-2e61509c0409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.508273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e67635-a95e-4485-a57a-2e61509c0409 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.509369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e67635-a95e-4485-a57a-2e61509c0409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.511785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e67635-a95e-4485-a57a-2e61509c0409 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.657821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1016/2037] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:24 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:24.660160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e67635-a95e-4485-a57a-2e61509c0409 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.740585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e67635-a95e-4485-a57a-2e61509c0409 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.745812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb30af-46c5-4169-ba07-4de56ba35557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.747122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb30af-46c5-4169-ba07-4de56ba35557 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.747122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb30af-46c5-4169-ba07-4de56ba35557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.747386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb30af-46c5-4169-ba07-4de56ba35557 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.748464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb30af-46c5-4169-ba07-4de56ba35557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.750602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb30af-46c5-4169-ba07-4de56ba35557 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.762412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a8d64e0c3de44c5b9a05d5a23c410a4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.763074 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a8d64e0c3de44c5b9a05d5a23c410a4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.878888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1017/2038] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:24 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:24.882751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb30af-46c5-4169-ba07-4de56ba35557 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.884337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3acb30af-46c5-4169-ba07-4de56ba35557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:24.896441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb30af-46c5-4169-ba07-4de56ba35557 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.902044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a688f-76b9-4e30-b3f5-45ca0b60d308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.902168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a8d64e0c3de44c5b9a05d5a23c410a4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.902523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a688f-76b9-4e30-b3f5-45ca0b60d308 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.902630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a8d64e0c3de44c5b9a05d5a23c410a4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.902819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a688f-76b9-4e30-b3f5-45ca0b60d308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.903102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a688f-76b9-4e30-b3f5-45ca0b60d308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.903849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a688f-76b9-4e30-b3f5-45ca0b60d308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.908035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a688f-76b9-4e30-b3f5-45ca0b60d308 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:24.917001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1018/2039] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:24.918049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a688f-76b9-4e30-b3f5-45ca0b60d308 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.919944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-786a688f-76b9-4e30-b3f5-45ca0b60d308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:24.930215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a8d64e0c3de44c5b9a05d5a23c410a4'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:24.934077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a688f-76b9-4e30-b3f5-45ca0b60d308 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:24.945569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1022/2040] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:24 2022] DELETE /identity/v3/users/7a8d64e0c3de44c5b9a05d5a23c410a4 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:24.945569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:24.947359 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:24.948171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:24.948455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:24.951058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] PATH_INFO: `/v3/projects/2188d352252c46dca156f5f137f2c7c7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:24.951058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2188d352252c46dca156f5f137f2c7c7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:24.952130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:25.019720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b022010-5a7a-4e34-bcd5-df1428ff865f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:25.024893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4bfd5-694a-4cda-a37c-d715a8a29ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:25.025568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4bfd5-694a-4cda-a37c-d715a8a29ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:25.025950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4bfd5-694a-4cda-a37c-d715a8a29ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:25.026253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4bfd5-694a-4cda-a37c-d715a8a29ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:25.026960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4bfd5-694a-4cda-a37c-d715a8a29ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:25.028558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4bfd5-694a-4cda-a37c-d715a8a29ac1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:25.039303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1023/2041] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:25.048319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4bfd5-694a-4cda-a37c-d715a8a29ac1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:25.058473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4bfd5-694a-4cda-a37c-d715a8a29ac1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:25.063079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63864cff-a3fc-4fb9-a96f-8d4b58a9f34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:25.064065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63864cff-a3fc-4fb9-a96f-8d4b58a9f34a admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:25.064356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63864cff-a3fc-4fb9-a96f-8d4b58a9f34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:25.064631 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63864cff-a3fc-4fb9-a96f-8d4b58a9f34a admin admin] PATH_INFO: `/v3/projects/2d7c11402fa94737be3e05efa24a8808/users/e4dc03126f644e3c92c0a195978f7010/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:25.077085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:25.081648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63864cff-a3fc-4fb9-a96f-8d4b58a9f34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7c11402fa94737be3e05efa24a8808, user_id=e4dc03126f644e3c92c0a195978f7010, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:25.084482 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63864cff-a3fc-4fb9-a96f-8d4b58a9f34a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:25.326020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1024/2042] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:25 2022] PUT /identity/v3/projects/2d7c11402fa94737be3e05efa24a8808/users/e4dc03126f644e3c92c0a195978f7010/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:25.328479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c312a3-7141-44ec-8f42-232e59229dcd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:25.328769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c312a3-7141-44ec-8f42-232e59229dcd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:25.329052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c312a3-7141-44ec-8f42-232e59229dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:25.333250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2188d352252c46dca156f5f137f2c7c7', 'request_id': 'req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:25.358540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2188d352252c46dca156f5f137f2c7c7', 'request_id': 'req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:25.366395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f2c312a3-7141-44ec-8f42-232e59229dcd None None] MFA Rules not processed for user `e4dc03126f644e3c92c0a195978f7010`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:25.367768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2188d352252c46dca156f5f137f2c7c7', 'request_id': 'req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:25.368524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f2c312a3-7141-44ec-8f42-232e59229dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:25.443602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1025/2043] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:25.455042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c312a3-7141-44ec-8f42-232e59229dcd None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:25.456661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f2c312a3-7141-44ec-8f42-232e59229dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:25.477835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] The token cache is being invalidate because project 2188d352252c46dca156f5f137f2c7c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:25.478140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:25.479209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-56abd2ef-385d-48cb-84d3-f2c7bd5509cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:25.481225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1019/2044] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:24 2022] DELETE /identity/v3/projects/2188d352252c46dca156f5f137f2c7c7 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:25.485873 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f226b-eb39-4f1c-bc83-c4a4520c6c1d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:25.486167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f226b-eb39-4f1c-bc83-c4a4520c6c1d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:25.486517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f226b-eb39-4f1c-bc83-c4a4520c6c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:25.508632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-015f226b-eb39-4f1c-bc83-c4a4520c6c1d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:25.510188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-015f226b-eb39-4f1c-bc83-c4a4520c6c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:25.546427 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c312a3-7141-44ec-8f42-232e59229dcd None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:25.551089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904dc4d6-8733-47d0-a708-4d48e840755e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:25.551832 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc4d6-8733-47d0-a708-4d48e840755e service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:25.552118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc4d6-8733-47d0-a708-4d48e840755e service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:25.552396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904dc4d6-8733-47d0-a708-4d48e840755e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:25.557217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-904dc4d6-8733-47d0-a708-4d48e840755e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:25.576652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dc4d6-8733-47d0-a708-4d48e840755e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:25.578250 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904dc4d6-8733-47d0-a708-4d48e840755e service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:25.590436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1026/2045] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:25.591893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1020/2046] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:25.600318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2eef1-c474-45fa-a628-cd4f99004e29 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:25.600593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2eef1-c474-45fa-a628-cd4f99004e29 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:25.600879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2eef1-c474-45fa-a628-cd4f99004e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:25.622686 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6dc2eef1-c474-45fa-a628-cd4f99004e29 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:25.623946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6dc2eef1-c474-45fa-a628-cd4f99004e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:25.637067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1027/2047] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:25.638969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f226b-eb39-4f1c-bc83-c4a4520c6c1d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:25.656381 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f226b-eb39-4f1c-bc83-c4a4520c6c1d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:25.660130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2eef1-c474-45fa-a628-cd4f99004e29 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:25.666079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a91db-d87d-47c6-b598-24358453bede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:25.666723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6dc2eef1-c474-45fa-a628-cd4f99004e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:25.666960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a91db-d87d-47c6-b598-24358453bede admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:25.667294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a91db-d87d-47c6-b598-24358453bede admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:25.667712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a91db-d87d-47c6-b598-24358453bede admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:25.668525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a91db-d87d-47c6-b598-24358453bede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:25.668910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a91db-d87d-47c6-b598-24358453bede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:25.670669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a91db-d87d-47c6-b598-24358453bede admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:25.692075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1021/2048] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:25.692900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2eef1-c474-45fa-a628-cd4f99004e29 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:25.696016 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a91db-d87d-47c6-b598-24358453bede admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:25.708806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:25.709569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:25.709951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:25.711309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] PATH_INFO: `/v3/projects/d5d2f9972e9e4aa691dd00d7a21c74e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:25.714258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d2f9972e9e4aa691dd00d7a21c74e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:25.716644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:25.718126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a91db-d87d-47c6-b598-24358453bede admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:25.727009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c26f09-3fd4-41db-a860-4aba9e848000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:25.727752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c26f09-3fd4-41db-a860-4aba9e848000 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:25.728377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c26f09-3fd4-41db-a860-4aba9e848000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:25.728970 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c26f09-3fd4-41db-a860-4aba9e848000 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:25.729692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c26f09-3fd4-41db-a860-4aba9e848000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:25.732518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c26f09-3fd4-41db-a860-4aba9e848000 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:25.810101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:25.937397 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d2f9972e9e4aa691dd00d7a21c74e3', 'request_id': 'req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:25.943188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d2f9972e9e4aa691dd00d7a21c74e3', 'request_id': 'req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:25.950818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d2f9972e9e4aa691dd00d7a21c74e3', 'request_id': 'req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:26.013815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1022/2049] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:25 2022] POST /identity/v3/projects => generated 377 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:26.026468 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c26f09-3fd4-41db-a860-4aba9e848000 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.043509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] The token cache is being invalidate because project d5d2f9972e9e4aa691dd00d7a21c74e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:26.043805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:26.044487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1d359967-8bc4-46c0-8f3a-294f4b58ecf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:26.050722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1028/2050] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:25 2022] DELETE /identity/v3/projects/d5d2f9972e9e4aa691dd00d7a21c74e3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:26.052431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebb054-c3cb-4f77-94d9-2bdbe1735220 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.052651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebb054-c3cb-4f77-94d9-2bdbe1735220 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.053064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ebb054-c3cb-4f77-94d9-2bdbe1735220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.075786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a9ebb054-c3cb-4f77-94d9-2bdbe1735220 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:26.077081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a9ebb054-c3cb-4f77-94d9-2bdbe1735220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:26.108701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c26f09-3fd4-41db-a860-4aba9e848000 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.113504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91000dbd-a401-47f9-bb50-dd54a3f94b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.114937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91000dbd-a401-47f9-bb50-dd54a3f94b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.115224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91000dbd-a401-47f9-bb50-dd54a3f94b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.116091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91000dbd-a401-47f9-bb50-dd54a3f94b49 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.116890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91000dbd-a401-47f9-bb50-dd54a3f94b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.118945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91000dbd-a401-47f9-bb50-dd54a3f94b49 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.150521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1029/2051] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:26.159315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43955b-a752-4c10-98ce-13e0aec586c2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.159650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43955b-a752-4c10-98ce-13e0aec586c2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.159933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43955b-a752-4c10-98ce-13e0aec586c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.178917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-aa43955b-a752-4c10-98ce-13e0aec586c2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:26.180340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aa43955b-a752-4c10-98ce-13e0aec586c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:26.189430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1030/2052] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:26.194265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43955b-a752-4c10-98ce-13e0aec586c2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.204326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43955b-a752-4c10-98ce-13e0aec586c2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.209284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f40f8-ca02-48ad-9bdf-49a88f375fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.210941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f40f8-ca02-48ad-9bdf-49a88f375fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.211232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f40f8-ca02-48ad-9bdf-49a88f375fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.211504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f40f8-ca02-48ad-9bdf-49a88f375fb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.212241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f40f8-ca02-48ad-9bdf-49a88f375fb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:26.212545 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f40f8-ca02-48ad-9bdf-49a88f375fb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.214321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f40f8-ca02-48ad-9bdf-49a88f375fb9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.228891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1031/2053] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:47:26.234269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f40f8-ca02-48ad-9bdf-49a88f375fb9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.247374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f40f8-ca02-48ad-9bdf-49a88f375fb9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.252345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a3d4-4926-466b-8679-a28b9e12891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.253031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a3d4-4926-466b-8679-a28b9e12891b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.253315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a3d4-4926-466b-8679-a28b9e12891b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.253589 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4a3d4-4926-466b-8679-a28b9e12891b admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.254311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4a3d4-4926-466b-8679-a28b9e12891b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.256263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4a3d4-4926-466b-8679-a28b9e12891b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.373615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1032/2054] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:26 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:26.375100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a3d4-4926-466b-8679-a28b9e12891b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.377746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5ad4a3d4-4926-466b-8679-a28b9e12891b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:26.388023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1023/2055] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:26 2022] POST /identity/v3/users => generated 289 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:26.389536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91000dbd-a401-47f9-bb50-dd54a3f94b49 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.407424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91000dbd-a401-47f9-bb50-dd54a3f94b49 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.457632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4a3d4-4926-466b-8679-a28b9e12891b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.463099 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.464016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.464300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.464591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] PATH_INFO: `/v3/users/4d380efbe8c44fb3bbc58c9913cb25e6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.465869 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d380efbe8c44fb3bbc58c9913cb25e6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.467826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.478265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff0cb0-56f8-490e-a73b-9762abe9812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.479277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff0cb0-56f8-490e-a73b-9762abe9812b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.479663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff0cb0-56f8-490e-a73b-9762abe9812b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.480043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff0cb0-56f8-490e-a73b-9762abe9812b admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.480809 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff0cb0-56f8-490e-a73b-9762abe9812b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.482975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff0cb0-56f8-490e-a73b-9762abe9812b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.584450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1024/2056] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:26 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:26.584450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff0cb0-56f8-490e-a73b-9762abe9812b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.584450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-96ff0cb0-56f8-490e-a73b-9762abe9812b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:26.607005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff0cb0-56f8-490e-a73b-9762abe9812b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.613124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968f392-9a9e-43aa-b3ca-f5bf69567665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.613939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968f392-9a9e-43aa-b3ca-f5bf69567665 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.614388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968f392-9a9e-43aa-b3ca-f5bf69567665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.614674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968f392-9a9e-43aa-b3ca-f5bf69567665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.615464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968f392-9a9e-43aa-b3ca-f5bf69567665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.617412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968f392-9a9e-43aa-b3ca-f5bf69567665 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.632915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1025/2057] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:26.634285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968f392-9a9e-43aa-b3ca-f5bf69567665 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.644540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968f392-9a9e-43aa-b3ca-f5bf69567665 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.651365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c200bcc-107e-4d43-aa5d-675d8ded2f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.652211 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c200bcc-107e-4d43-aa5d-675d8ded2f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.652517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c200bcc-107e-4d43-aa5d-675d8ded2f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.652791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c200bcc-107e-4d43-aa5d-675d8ded2f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.654028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c200bcc-107e-4d43-aa5d-675d8ded2f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.655420 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c200bcc-107e-4d43-aa5d-675d8ded2f1b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.668115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d380efbe8c44fb3bbc58c9913cb25e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:26.668826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d380efbe8c44fb3bbc58c9913cb25e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:26.673797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1026/2058] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:26.673797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c200bcc-107e-4d43-aa5d-675d8ded2f1b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.673797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7c200bcc-107e-4d43-aa5d-675d8ded2f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:26.685413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c200bcc-107e-4d43-aa5d-675d8ded2f1b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.690629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f064585-d2ea-4f42-97d5-53a6561edbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.691319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f064585-d2ea-4f42-97d5-53a6561edbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.691609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f064585-d2ea-4f42-97d5-53a6561edbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.691892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f064585-d2ea-4f42-97d5-53a6561edbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.692629 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f064585-d2ea-4f42-97d5-53a6561edbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.694300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f064585-d2ea-4f42-97d5-53a6561edbc9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.705277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1027/2059] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:26.706206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f064585-d2ea-4f42-97d5-53a6561edbc9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.708406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7f064585-d2ea-4f42-97d5-53a6561edbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:26.725338 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f064585-d2ea-4f42-97d5-53a6561edbc9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.728854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857f417-5f11-43e8-ad6a-6756515d2e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.729537 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f417-5f11-43e8-ad6a-6756515d2e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.729864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f417-5f11-43e8-ad6a-6756515d2e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.730140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7857f417-5f11-43e8-ad6a-6756515d2e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.730877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857f417-5f11-43e8-ad6a-6756515d2e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.732476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7857f417-5f11-43e8-ad6a-6756515d2e96 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.741179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d380efbe8c44fb3bbc58c9913cb25e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:26.741934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d380efbe8c44fb3bbc58c9913cb25e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:26.747167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1028/2060] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:26.747167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857f417-5f11-43e8-ad6a-6756515d2e96 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.758918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d380efbe8c44fb3bbc58c9913cb25e6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:26.759123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7857f417-5f11-43e8-ad6a-6756515d2e96 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.764568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13025b04-8203-4dc5-91ac-f14c86b2eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.765469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025b04-8203-4dc5-91ac-f14c86b2eeba admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.765784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025b04-8203-4dc5-91ac-f14c86b2eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.766068 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13025b04-8203-4dc5-91ac-f14c86b2eeba admin admin] PATH_INFO: `/v3/projects/8f62a9832f8e49c1841a209d1198af4d/users/bb3f105073184b5c8f57a208c29e87c8/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.772092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1033/2061] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:26 2022] DELETE /identity/v3/users/4d380efbe8c44fb3bbc58c9913cb25e6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:26.775922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:26.794748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13025b04-8203-4dc5-91ac-f14c86b2eeba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f62a9832f8e49c1841a209d1198af4d, user_id=bb3f105073184b5c8f57a208c29e87c8, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.797924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13025b04-8203-4dc5-91ac-f14c86b2eeba admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.845226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3e71-e7b5-497a-b5f2-27ffd690e77e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:26.852257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7df4b3-522d-4d0a-9797-5a1522f18404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:26.853488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df4b3-522d-4d0a-9797-5a1522f18404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.853966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df4b3-522d-4d0a-9797-5a1522f18404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.854396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7df4b3-522d-4d0a-9797-5a1522f18404 admin admin] PATH_INFO: `/v3/projects/8e13fd94e9d94004aae0ae93c0dcb2a8/users/e105a6165cdb4befabab5b2c03af8fe6/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.874628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7df4b3-522d-4d0a-9797-5a1522f18404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e13fd94e9d94004aae0ae93c0dcb2a8, user_id=e105a6165cdb4befabab5b2c03af8fe6, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:26.878540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7df4b3-522d-4d0a-9797-5a1522f18404 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:26.922833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1029/2062] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:26 2022] PUT /identity/v3/projects/8f62a9832f8e49c1841a209d1198af4d/users/bb3f105073184b5c8f57a208c29e87c8/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:26.934835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706decc-f487-4e78-be91-75b432794b3d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:26.935179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706decc-f487-4e78-be91-75b432794b3d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:26.935447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706decc-f487-4e78-be91-75b432794b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:26.965988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5706decc-f487-4e78-be91-75b432794b3d None None] MFA Rules not processed for user `bb3f105073184b5c8f57a208c29e87c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:26.967227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5706decc-f487-4e78-be91-75b432794b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:27.013325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1034/2063] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:26 2022] PUT /identity/v3/projects/8e13fd94e9d94004aae0ae93c0dcb2a8/users/e105a6165cdb4befabab5b2c03af8fe6/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:27.022422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6de02-2283-45e9-9dda-d4a2b2163203 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.022948 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6de02-2283-45e9-9dda-d4a2b2163203 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.023232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6de02-2283-45e9-9dda-d4a2b2163203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.035399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1030/2064] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:27.047047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706decc-f487-4e78-be91-75b432794b3d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.048417 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5706decc-f487-4e78-be91-75b432794b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:27.051761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-15e6de02-2283-45e9-9dda-d4a2b2163203 None None] MFA Rules not processed for user `e105a6165cdb4befabab5b2c03af8fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:27.053362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-15e6de02-2283-45e9-9dda-d4a2b2163203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:27.111672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706decc-f487-4e78-be91-75b432794b3d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.126316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1035/2065] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:27.127213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6de02-2283-45e9-9dda-d4a2b2163203 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.128599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-15e6de02-2283-45e9-9dda-d4a2b2163203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:27.163572 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:27.175288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003e9e1-c53e-496b-a49f-ceee98bc2a59 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079eeefcd0654dfe9cd4a9c51d239298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.176193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e9e1-c53e-496b-a49f-ceee98bc2a59 service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.176371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e9e1-c53e-496b-a49f-ceee98bc2a59 service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.176621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e9e1-c53e-496b-a49f-ceee98bc2a59 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.201186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6de02-2283-45e9-9dda-d4a2b2163203 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.206259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.207148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.207422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.207706 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] PATH_INFO: `/v3/projects/3cd0ea68fb8a43e886d0c9722d766ba6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.208939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cd0ea68fb8a43e886d0c9722d766ba6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.211463 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.237090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003e9e1-c53e-496b-a49f-ceee98bc2a59 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.239331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003e9e1-c53e-496b-a49f-ceee98bc2a59 service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.248458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1031/2066] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:27.249225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003e9e1-c53e-496b-a49f-ceee98bc2a59 service glance] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.259408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003e9e1-c53e-496b-a49f-ceee98bc2a59 service glance] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.264927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89876fab-0ff4-4105-a7e2-1b7a7f60a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.265548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89876fab-0ff4-4105-a7e2-1b7a7f60a734 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.265978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89876fab-0ff4-4105-a7e2-1b7a7f60a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.266323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89876fab-0ff4-4105-a7e2-1b7a7f60a734 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.267084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89876fab-0ff4-4105-a7e2-1b7a7f60a734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.269116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89876fab-0ff4-4105-a7e2-1b7a7f60a734 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.433488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cd0ea68fb8a43e886d0c9722d766ba6', 'request_id': 'req-095dcded-ddea-4956-a1e8-212217d55756'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:27.441051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cd0ea68fb8a43e886d0c9722d766ba6', 'request_id': 'req-095dcded-ddea-4956-a1e8-212217d55756'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:27.449402 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cd0ea68fb8a43e886d0c9722d766ba6', 'request_id': 'req-095dcded-ddea-4956-a1e8-212217d55756'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:27.480778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1032/2067] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:27 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:27.485852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89876fab-0ff4-4105-a7e2-1b7a7f60a734 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.550117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89876fab-0ff4-4105-a7e2-1b7a7f60a734 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.554801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af51e94-7bee-46c6-8d8c-c8b4626cfcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.555469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af51e94-7bee-46c6-8d8c-c8b4626cfcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.555790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af51e94-7bee-46c6-8d8c-c8b4626cfcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.556078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af51e94-7bee-46c6-8d8c-c8b4626cfcf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.556780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af51e94-7bee-46c6-8d8c-c8b4626cfcf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.559000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af51e94-7bee-46c6-8d8c-c8b4626cfcf5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.576405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] The token cache is being invalidate because project 3cd0ea68fb8a43e886d0c9722d766ba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:27.576935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:27.581728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-095dcded-ddea-4956-a1e8-212217d55756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:27.581728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1036/2068] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:27 2022] DELETE /identity/v3/projects/3cd0ea68fb8a43e886d0c9722d766ba6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:27.584400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d7a48-e2c5-4798-bedd-01631ee621a7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.584697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d7a48-e2c5-4798-bedd-01631ee621a7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.584994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d7a48-e2c5-4798-bedd-01631ee621a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.606151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-752d7a48-e2c5-4798-bedd-01631ee621a7 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:27.607445 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-752d7a48-e2c5-4798-bedd-01631ee621a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:27.615907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1037/2069] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:27.623489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432c901-1347-402f-96a1-a5b3e2f6c228 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.623814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432c901-1347-402f-96a1-a5b3e2f6c228 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.624100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432c901-1347-402f-96a1-a5b3e2f6c228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.643946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6432c901-1347-402f-96a1-a5b3e2f6c228 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:27.645158 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6432c901-1347-402f-96a1-a5b3e2f6c228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:27.653771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1038/2070] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:27.657981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432c901-1347-402f-96a1-a5b3e2f6c228 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.667796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1033/2071] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:27 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:27.667951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432c901-1347-402f-96a1-a5b3e2f6c228 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.672566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086587dc-c990-47dc-b267-b8a11c4e83db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.673452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086587dc-c990-47dc-b267-b8a11c4e83db admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.673555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086587dc-c990-47dc-b267-b8a11c4e83db admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.673859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086587dc-c990-47dc-b267-b8a11c4e83db admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.674587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086587dc-c990-47dc-b267-b8a11c4e83db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:27.674891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086587dc-c990-47dc-b267-b8a11c4e83db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.676041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af51e94-7bee-46c6-8d8c-c8b4626cfcf5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.676640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086587dc-c990-47dc-b267-b8a11c4e83db admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.677788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7af51e94-7bee-46c6-8d8c-c8b4626cfcf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:27.689550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1039/2072] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:47:27.690497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af51e94-7bee-46c6-8d8c-c8b4626cfcf5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.693811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086587dc-c990-47dc-b267-b8a11c4e83db admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.695193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73717811-060b-4d3c-a67a-ba5006ebfcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.695859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73717811-060b-4d3c-a67a-ba5006ebfcaf admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.696147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73717811-060b-4d3c-a67a-ba5006ebfcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.696424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73717811-060b-4d3c-a67a-ba5006ebfcaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.697139 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73717811-060b-4d3c-a67a-ba5006ebfcaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.698772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73717811-060b-4d3c-a67a-ba5006ebfcaf admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.703925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086587dc-c990-47dc-b267-b8a11c4e83db admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.708935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3d55f-8d4e-40be-92fe-3b777818564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.709392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1034/2073] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:27.709585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d55f-8d4e-40be-92fe-3b777818564a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.709909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d55f-8d4e-40be-92fe-3b777818564a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.710191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3d55f-8d4e-40be-92fe-3b777818564a admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.711400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3d55f-8d4e-40be-92fe-3b777818564a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.713610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3d55f-8d4e-40be-92fe-3b777818564a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.713793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73717811-060b-4d3c-a67a-ba5006ebfcaf admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.723975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73717811-060b-4d3c-a67a-ba5006ebfcaf admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.732231 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b6579-f196-4e0d-98f1-7bb006870aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.733171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6579-f196-4e0d-98f1-7bb006870aef admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.733454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6579-f196-4e0d-98f1-7bb006870aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.733763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4b6579-f196-4e0d-98f1-7bb006870aef admin admin] PATH_INFO: `/v3/projects/82e6a0e5f6c348c7a9c7518b2e6c8474/users/dc7ab574337247d99e2ccd42c412a1da/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.749207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b6579-f196-4e0d-98f1-7bb006870aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e6a0e5f6c348c7a9c7518b2e6c8474, user_id=dc7ab574337247d99e2ccd42c412a1da, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.751942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4b6579-f196-4e0d-98f1-7bb006870aef admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.806142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1040/2074] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:27 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:27.810076 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3d55f-8d4e-40be-92fe-3b777818564a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.823402 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1035/2075] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:27 2022] PUT /identity/v3/projects/82e6a0e5f6c348c7a9c7518b2e6c8474/users/dc7ab574337247d99e2ccd42c412a1da/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:27.830374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b6579-f196-4e0d-98f1-7bb006870aef admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.877915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3d55f-8d4e-40be-92fe-3b777818564a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.901861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4b6579-f196-4e0d-98f1-7bb006870aef admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.908499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535881bd-8852-4f30-9550-e896e41111f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.909178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535881bd-8852-4f30-9550-e896e41111f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.910092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535881bd-8852-4f30-9550-e896e41111f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.910092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535881bd-8852-4f30-9550-e896e41111f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.910553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535881bd-8852-4f30-9550-e896e41111f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.912496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535881bd-8852-4f30-9550-e896e41111f5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.926810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1036/2076] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:27.927993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535881bd-8852-4f30-9550-e896e41111f5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:27.938244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535881bd-8852-4f30-9550-e896e41111f5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:27.943107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108e4b-7115-491d-b6f7-c0e6b96ae8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.943362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2a2c1-ad0d-4f44-b4ed-31b505613827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:27.944176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108e4b-7115-491d-b6f7-c0e6b96ae8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.944287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2a2c1-ad0d-4f44-b4ed-31b505613827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.944544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2a2c1-ad0d-4f44-b4ed-31b505613827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.944671 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108e4b-7115-491d-b6f7-c0e6b96ae8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.944851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2a2c1-ad0d-4f44-b4ed-31b505613827 admin admin] PATH_INFO: `/v3/projects/82e6a0e5f6c348c7a9c7518b2e6c8474/users/dc7ab574337247d99e2ccd42c412a1da/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.945080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108e4b-7115-491d-b6f7-c0e6b96ae8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:27.946320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36108e4b-7115-491d-b6f7-c0e6b96ae8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.946884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2a2c1-ad0d-4f44-b4ed-31b505613827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e6a0e5f6c348c7a9c7518b2e6c8474, user_id=dc7ab574337247d99e2ccd42c412a1da, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:27.949550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2a2c1-ad0d-4f44-b4ed-31b505613827 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.949658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36108e4b-7115-491d-b6f7-c0e6b96ae8f0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:27.961507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1037/2077] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:27 2022] PUT /identity/v3/projects/82e6a0e5f6c348c7a9c7518b2e6c8474/users/dc7ab574337247d99e2ccd42c412a1da/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:27.972933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36376dc7-1c01-4472-adab-0ad6c8bfefcc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:27.973224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36376dc7-1c01-4472-adab-0ad6c8bfefcc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:27.979741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36376dc7-1c01-4472-adab-0ad6c8bfefcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.001340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-36376dc7-1c01-4472-adab-0ad6c8bfefcc None None] MFA Rules not processed for user `dc7ab574337247d99e2ccd42c412a1da`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.002515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-36376dc7-1c01-4472-adab-0ad6c8bfefcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.078910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1038/2078] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:28.102053 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:28.105513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36376dc7-1c01-4472-adab-0ad6c8bfefcc None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.107369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-36376dc7-1c01-4472-adab-0ad6c8bfefcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.112308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1041/2079] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:27 2022] POST /identity/v3/users => generated 286 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:28.117376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108e4b-7115-491d-b6f7-c0e6b96ae8f0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.130213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108e4b-7115-491d-b6f7-c0e6b96ae8f0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.199434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36376dc7-1c01-4472-adab-0ad6c8bfefcc None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.204666 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60393c01-0760-4fe8-a190-a34ff9d7eb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.205423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393c01-0760-4fe8-a190-a34ff9d7eb5a service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.205747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393c01-0760-4fe8-a190-a34ff9d7eb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.206038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60393c01-0760-4fe8-a190-a34ff9d7eb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.208072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-60393c01-0760-4fe8-a190-a34ff9d7eb5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.212720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f614f-9bdb-4039-a66d-22be2d0fa308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.213413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f614f-9bdb-4039-a66d-22be2d0fa308 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.213721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f614f-9bdb-4039-a66d-22be2d0fa308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.214005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f614f-9bdb-4039-a66d-22be2d0fa308 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.214750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f614f-9bdb-4039-a66d-22be2d0fa308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.216436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25f614f-9bdb-4039-a66d-22be2d0fa308 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.229160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1042/2080] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:28.233568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f614f-9bdb-4039-a66d-22be2d0fa308 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.244987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25f614f-9bdb-4039-a66d-22be2d0fa308 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.250426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c6065-a2cc-4f06-bf68-f8176f7fcf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.251102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c6065-a2cc-4f06-bf68-f8176f7fcf55 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.251391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c6065-a2cc-4f06-bf68-f8176f7fcf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.251669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c6065-a2cc-4f06-bf68-f8176f7fcf55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.252476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c6065-a2cc-4f06-bf68-f8176f7fcf55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.254789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c6065-a2cc-4f06-bf68-f8176f7fcf55 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.267270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1043/2081] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:28.271188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c6065-a2cc-4f06-bf68-f8176f7fcf55 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.286546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c6065-a2cc-4f06-bf68-f8176f7fcf55 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.290788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60393c01-0760-4fe8-a190-a34ff9d7eb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.292338 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60393c01-0760-4fe8-a190-a34ff9d7eb5a service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.297112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61ba16-9ecf-487e-9a6d-7efddfc6885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.298052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61ba16-9ecf-487e-9a6d-7efddfc6885f admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.298333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61ba16-9ecf-487e-9a6d-7efddfc6885f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.298610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61ba16-9ecf-487e-9a6d-7efddfc6885f admin admin] PATH_INFO: `/v3/projects/4e4b7aab50fd468baef55246c935680b/users/ad0a74d5c49643e49e4e21398ebaebef/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.304968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1039/2082] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:28.325122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61ba16-9ecf-487e-9a6d-7efddfc6885f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4b7aab50fd468baef55246c935680b, user_id=ad0a74d5c49643e49e4e21398ebaebef, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.329246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61ba16-9ecf-487e-9a6d-7efddfc6885f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.439692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1044/2083] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:28 2022] PUT /identity/v3/projects/4e4b7aab50fd468baef55246c935680b/users/ad0a74d5c49643e49e4e21398ebaebef/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:28.452321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555b10-e2ec-46b2-a7a2-db6f4deb2615 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.454442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555b10-e2ec-46b2-a7a2-db6f4deb2615 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.454845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe555b10-e2ec-46b2-a7a2-db6f4deb2615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.487264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fe555b10-e2ec-46b2-a7a2-db6f4deb2615 None None] MFA Rules not processed for user `ad0a74d5c49643e49e4e21398ebaebef`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.488849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fe555b10-e2ec-46b2-a7a2-db6f4deb2615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.583611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1040/2084] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.590351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61ba16-9ecf-487e-9a6d-7efddfc6885f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.672988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61ba16-9ecf-487e-9a6d-7efddfc6885f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.678734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3654c1-4c27-405e-b88e-740c8e7252fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.679420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3654c1-4c27-405e-b88e-740c8e7252fe admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.679755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3654c1-4c27-405e-b88e-740c8e7252fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.679987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3654c1-4c27-405e-b88e-740c8e7252fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.680696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3654c1-4c27-405e-b88e-740c8e7252fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.682724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3654c1-4c27-405e-b88e-740c8e7252fe admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.757732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:28.822202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1045/2085] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:28.826052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe555b10-e2ec-46b2-a7a2-db6f4deb2615 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.837594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe555b10-e2ec-46b2-a7a2-db6f4deb2615 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.902317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e50b5-9ec2-479b-bd06-e674a7eef803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.903005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e50b5-9ec2-479b-bd06-e674a7eef803 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.903287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e50b5-9ec2-479b-bd06-e674a7eef803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.907443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e50b5-9ec2-479b-bd06-e674a7eef803 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.907443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e50b5-9ec2-479b-bd06-e674a7eef803 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.907443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e50b5-9ec2-479b-bd06-e674a7eef803 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.994476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1041/2086] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:28.998609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3654c1-4c27-405e-b88e-740c8e7252fe admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.010022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3654c1-4c27-405e-b88e-740c8e7252fe admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.014800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd2869-8f73-4609-b151-7c779c7bce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.015510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2869-8f73-4609-b151-7c779c7bce3c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.015754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2869-8f73-4609-b151-7c779c7bce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.016034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd2869-8f73-4609-b151-7c779c7bce3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.016757 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd2869-8f73-4609-b151-7c779c7bce3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.018499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd2869-8f73-4609-b151-7c779c7bce3c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.030643 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1046/2087] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:29.035208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e50b5-9ec2-479b-bd06-e674a7eef803 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.046378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e50b5-9ec2-479b-bd06-e674a7eef803 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.051647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba145dd0-10a6-4e8a-aaef-9f6c950ba5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.052460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba145dd0-10a6-4e8a-aaef-9f6c950ba5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.052740 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba145dd0-10a6-4e8a-aaef-9f6c950ba5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.053015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba145dd0-10a6-4e8a-aaef-9f6c950ba5a9 admin admin] PATH_INFO: `/v3/projects/0752524a9d97496bbc21a11bfafc73bd/users/5baf45b81567429f914782091471f7d1/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.068572 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba145dd0-10a6-4e8a-aaef-9f6c950ba5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0752524a9d97496bbc21a11bfafc73bd, user_id=5baf45b81567429f914782091471f7d1, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.071865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba145dd0-10a6-4e8a-aaef-9f6c950ba5a9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.263342 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1042/2088] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:29 2022] PUT /identity/v3/projects/0752524a9d97496bbc21a11bfafc73bd/users/5baf45b81567429f914782091471f7d1/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:29.274346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd2869-8f73-4609-b151-7c779c7bce3c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.285639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd2869-8f73-4609-b151-7c779c7bce3c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.356553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a7b745-18fc-4cd5-86f3-09b9b2c66cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.357858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7b745-18fc-4cd5-86f3-09b9b2c66cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.358128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7b745-18fc-4cd5-86f3-09b9b2c66cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.358510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a7b745-18fc-4cd5-86f3-09b9b2c66cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.359365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7b745-18fc-4cd5-86f3-09b9b2c66cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.361128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a7b745-18fc-4cd5-86f3-09b9b2c66cb9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.373631 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1047/2089] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:29.378589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba145dd0-10a6-4e8a-aaef-9f6c950ba5a9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.397594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba145dd0-10a6-4e8a-aaef-9f6c950ba5a9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.409424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31008c18-e2fb-4b02-ab61-c0c532193182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.410375 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31008c18-e2fb-4b02-ab61-c0c532193182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.410654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31008c18-e2fb-4b02-ab61-c0c532193182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.410930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31008c18-e2fb-4b02-ab61-c0c532193182 admin admin] PATH_INFO: `/v3/projects/0752524a9d97496bbc21a11bfafc73bd/users/5baf45b81567429f914782091471f7d1/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.412998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31008c18-e2fb-4b02-ab61-c0c532193182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0752524a9d97496bbc21a11bfafc73bd, user_id=5baf45b81567429f914782091471f7d1, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.424533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31008c18-e2fb-4b02-ab61-c0c532193182 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.447300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1043/2090] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:29 2022] PUT /identity/v3/projects/0752524a9d97496bbc21a11bfafc73bd/users/5baf45b81567429f914782091471f7d1/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:29.458247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad87274-0a2f-4140-98e0-fc01511343c6 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.458647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad87274-0a2f-4140-98e0-fc01511343c6 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.458947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad87274-0a2f-4140-98e0-fc01511343c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.488966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5ad87274-0a2f-4140-98e0-fc01511343c6 None None] MFA Rules not processed for user `5baf45b81567429f914782091471f7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:29.490301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5ad87274-0a2f-4140-98e0-fc01511343c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:29.563675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1048/2091] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:29 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:29.575699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31008c18-e2fb-4b02-ab61-c0c532193182 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.635263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31008c18-e2fb-4b02-ab61-c0c532193182 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.639709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c354e70-bb6e-416e-9b43-8cb42d91765b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.640568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c354e70-bb6e-416e-9b43-8cb42d91765b service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.640718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c354e70-bb6e-416e-9b43-8cb42d91765b service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.641255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c354e70-bb6e-416e-9b43-8cb42d91765b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.651942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c354e70-bb6e-416e-9b43-8cb42d91765b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.653372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c354e70-bb6e-416e-9b43-8cb42d91765b service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.664208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1044/2092] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:29.959773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad87274-0a2f-4140-98e0-fc01511343c6 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.969944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad87274-0a2f-4140-98e0-fc01511343c6 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.973432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde8715-d67d-4d93-9bc1-e28a4abee046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.974186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8715-d67d-4d93-9bc1-e28a4abee046 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.974472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8715-d67d-4d93-9bc1-e28a4abee046 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.974754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde8715-d67d-4d93-9bc1-e28a4abee046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.051115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde8715-d67d-4d93-9bc1-e28a4abee046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.052642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde8715-d67d-4d93-9bc1-e28a4abee046 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.061697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1049/2093] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:30.888473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:31.119059 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:32.603794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:33.483786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:33.764700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:34.543619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c354e70-bb6e-416e-9b43-8cb42d91765b service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:34.552804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c354e70-bb6e-416e-9b43-8cb42d91765b service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.558001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c68cc-add0-42db-a1ba-b2ec35058781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.558993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c68cc-add0-42db-a1ba-b2ec35058781 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.559816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c68cc-add0-42db-a1ba-b2ec35058781 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.560116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c68cc-add0-42db-a1ba-b2ec35058781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.631970 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c68cc-add0-42db-a1ba-b2ec35058781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.634024 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c68cc-add0-42db-a1ba-b2ec35058781 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:34.643835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1045/2094] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:34 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:35.415985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:35.726835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde8715-d67d-4d93-9bc1-e28a4abee046 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:35.728647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-edde8715-d67d-4d93-9bc1-e28a4abee046 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.736524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:35.826617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde8715-d67d-4d93-9bc1-e28a4abee046 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:35.833142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:35.834464 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.835041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.836126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] PATH_INFO: `/v3/users/c5612c2293de43399f6b35516205ec89` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.837640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5612c2293de43399f6b35516205ec89)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:35.839919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:36.063388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5612c2293de43399f6b35516205ec89'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:36.064047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5612c2293de43399f6b35516205ec89'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:36.192077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5612c2293de43399f6b35516205ec89'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:36.192898 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5612c2293de43399f6b35516205ec89'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:36.209256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5612c2293de43399f6b35516205ec89'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:36.223850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1050/2095] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:35 2022] DELETE /identity/v3/users/c5612c2293de43399f6b35516205ec89 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:36.228470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9fd62-0643-4ee4-baa6-1c6dc21eb3ce None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:36.228762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9fd62-0643-4ee4-baa6-1c6dc21eb3ce None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:36.229049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9fd62-0643-4ee4-baa6-1c6dc21eb3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:36.247041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-beb9fd62-0643-4ee4-baa6-1c6dc21eb3ce None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:36.248274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-beb9fd62-0643-4ee4-baa6-1c6dc21eb3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:36.324356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1046/2096] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:36.334006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:36.336033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:36.412076 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4db556-17ac-4040-a4f6-2dfa755b7b7e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:36.424418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4436e0e-1767-444d-8719-ac42976add73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:36.424418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4436e0e-1767-444d-8719-ac42976add73 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:36.424418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4436e0e-1767-444d-8719-ac42976add73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:36.424418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4436e0e-1767-444d-8719-ac42976add73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:36.435022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4436e0e-1767-444d-8719-ac42976add73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:36.436520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4436e0e-1767-444d-8719-ac42976add73 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:36.446943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1051/2097] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:36.936897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9fd62-0643-4ee4-baa6-1c6dc21eb3ce None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:36.938402 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-beb9fd62-0643-4ee4-baa6-1c6dc21eb3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:36.955564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9fd62-0643-4ee4-baa6-1c6dc21eb3ce None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:36.964372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:36.965974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:36.966501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:36.967009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] PATH_INFO: `/v3/projects/62bf6733067b40148ceb22d77585cbdc` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:36.969785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62bf6733067b40148ceb22d77585cbdc)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:36.972779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:37.158764 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62bf6733067b40148ceb22d77585cbdc', 'request_id': 'req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.164347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62bf6733067b40148ceb22d77585cbdc', 'request_id': 'req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.170719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62bf6733067b40148ceb22d77585cbdc', 'request_id': 'req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.312147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] The token cache is being invalidate because project 62bf6733067b40148ceb22d77585cbdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:37.312361 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.313003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0002cc3c-8c58-4240-94e5-3cd16cfb07c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.314651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1047/2098] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:36 2022] DELETE /identity/v3/projects/62bf6733067b40148ceb22d77585cbdc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:37.320234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e884a51-0327-4c3d-b596-de21d219808f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:37.320554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e884a51-0327-4c3d-b596-de21d219808f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:37.320835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e884a51-0327-4c3d-b596-de21d219808f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:37.336958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:37.339707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0e884a51-0327-4c3d-b596-de21d219808f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:37.340323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0e884a51-0327-4c3d-b596-de21d219808f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:37.405963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1052/2099] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:37.414726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142cbc9-4f31-42ad-b84f-4908b420536d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:37.415027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142cbc9-4f31-42ad-b84f-4908b420536d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:37.415307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142cbc9-4f31-42ad-b84f-4908b420536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:37.434672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d142cbc9-4f31-42ad-b84f-4908b420536d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:37.435881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d142cbc9-4f31-42ad-b84f-4908b420536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:37.445477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1048/2100] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:37.451358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e884a51-0327-4c3d-b596-de21d219808f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:37.462605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e884a51-0327-4c3d-b596-de21d219808f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:37.467624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c2ab-af73-4222-8f66-01f642e257e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:37.471230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c2ab-af73-4222-8f66-01f642e257e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:37.471230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c2ab-af73-4222-8f66-01f642e257e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:37.471230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c2ab-af73-4222-8f66-01f642e257e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:37.471230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c2ab-af73-4222-8f66-01f642e257e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:37.471230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c2ab-af73-4222-8f66-01f642e257e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:37.471929 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c2ab-af73-4222-8f66-01f642e257e1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:37.484895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1053/2101] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:37.489385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142cbc9-4f31-42ad-b84f-4908b420536d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:37.497117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:37.509310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142cbc9-4f31-42ad-b84f-4908b420536d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:37.509310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7cc7c-6b74-41f5-ac68-561031af2957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:37.509310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7cc7c-6b74-41f5-ac68-561031af2957 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:37.509310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7cc7c-6b74-41f5-ac68-561031af2957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:37.509883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7cc7c-6b74-41f5-ac68-561031af2957 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:37.509883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7cc7c-6b74-41f5-ac68-561031af2957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:37.510996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7cc7c-6b74-41f5-ac68-561031af2957 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:37.619775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:37.627527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1049/2102] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:37 2022] POST /identity/v3/projects => generated 377 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:37.631535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c2ab-af73-4222-8f66-01f642e257e1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:37.641835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c2ab-af73-4222-8f66-01f642e257e1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:37.701782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1280-9b88-4c60-84b3-acdda01be1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:37.702467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1280-9b88-4c60-84b3-acdda01be1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:37.702752 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1280-9b88-4c60-84b3-acdda01be1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:37.703034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1280-9b88-4c60-84b3-acdda01be1b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:37.703731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc1280-9b88-4c60-84b3-acdda01be1b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:37.705703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc1280-9b88-4c60-84b3-acdda01be1b1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:37.805976 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1054/2103] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:37 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:37.810870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7cc7c-6b74-41f5-ac68-561031af2957 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:37.821654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7cc7c-6b74-41f5-ac68-561031af2957 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:37.827007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fc32b-378a-4135-b9b3-277adc90879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:37.827686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fc32b-378a-4135-b9b3-277adc90879a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:37.827969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fc32b-378a-4135-b9b3-277adc90879a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:37.828247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18fc32b-378a-4135-b9b3-277adc90879a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:37.828987 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fc32b-378a-4135-b9b3-277adc90879a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:37.830677 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18fc32b-378a-4135-b9b3-277adc90879a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:37.841733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1050/2104] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:37.845753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1280-9b88-4c60-84b3-acdda01be1b1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:37.856962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1280-9b88-4c60-84b3-acdda01be1b1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:37.861649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11bee7-02e5-4472-bec0-b975467e357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:37.862354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11bee7-02e5-4472-bec0-b975467e357c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:37.862642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11bee7-02e5-4472-bec0-b975467e357c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:37.862924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11bee7-02e5-4472-bec0-b975467e357c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:37.863654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11bee7-02e5-4472-bec0-b975467e357c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:37.865305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c11bee7-02e5-4472-bec0-b975467e357c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:37.876547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1055/2105] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:37.880623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fc32b-378a-4135-b9b3-277adc90879a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:37.890990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18fc32b-378a-4135-b9b3-277adc90879a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:37.895945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093c42c-5e05-4aa7-ad74-90153f44c3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:37.896832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093c42c-5e05-4aa7-ad74-90153f44c3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:37.897118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093c42c-5e05-4aa7-ad74-90153f44c3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:37.897395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093c42c-5e05-4aa7-ad74-90153f44c3f7 admin admin] PATH_INFO: `/v3/projects/be74ce70a7ca4c6b9c499703c96da9c1/users/d3ee53570e5e4bff9aba3ad5c338da34/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:37.914285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093c42c-5e05-4aa7-ad74-90153f44c3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be74ce70a7ca4c6b9c499703c96da9c1, user_id=d3ee53570e5e4bff9aba3ad5c338da34, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:37.917084 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093c42c-5e05-4aa7-ad74-90153f44c3f7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:38.050295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1051/2106] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:37 2022] PUT /identity/v3/projects/be74ce70a7ca4c6b9c499703c96da9c1/users/d3ee53570e5e4bff9aba3ad5c338da34/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:38.061869 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0837d4-9141-423f-8c69-2d3d089f19f4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:38.062162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0837d4-9141-423f-8c69-2d3d089f19f4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:38.062440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0837d4-9141-423f-8c69-2d3d089f19f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:38.092407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7c0837d4-9141-423f-8c69-2d3d089f19f4 None None] MFA Rules not processed for user `d3ee53570e5e4bff9aba3ad5c338da34`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:38.093794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7c0837d4-9141-423f-8c69-2d3d089f19f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:38.160079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1056/2107] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:38.165224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093c42c-5e05-4aa7-ad74-90153f44c3f7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:38.231167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093c42c-5e05-4aa7-ad74-90153f44c3f7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:38.235976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603b2eb-a234-4ed8-a59c-ffec12f9ed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:38.236646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603b2eb-a234-4ed8-a59c-ffec12f9ed7b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:38.236931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603b2eb-a234-4ed8-a59c-ffec12f9ed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:38.237209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603b2eb-a234-4ed8-a59c-ffec12f9ed7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:38.237939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603b2eb-a234-4ed8-a59c-ffec12f9ed7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:38.239912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603b2eb-a234-4ed8-a59c-ffec12f9ed7b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:38.406654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1052/2108] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:38 2022] POST /identity/v3/projects => generated 375 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:38.410704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0837d4-9141-423f-8c69-2d3d089f19f4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:38.421316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0837d4-9141-423f-8c69-2d3d089f19f4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:38.487822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685d104-91da-4857-b085-173c7b21fd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:38.492594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685d104-91da-4857-b085-173c7b21fd26 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:38.492594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685d104-91da-4857-b085-173c7b21fd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:38.492594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685d104-91da-4857-b085-173c7b21fd26 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:38.492594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685d104-91da-4857-b085-173c7b21fd26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:38.492594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685d104-91da-4857-b085-173c7b21fd26 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:38.581804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1057/2109] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:38 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:38.586045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603b2eb-a234-4ed8-a59c-ffec12f9ed7b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:38.596975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603b2eb-a234-4ed8-a59c-ffec12f9ed7b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:38.602521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d298678-cedc-49f1-bb5a-0dbfc7a0e31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:38.603215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d298678-cedc-49f1-bb5a-0dbfc7a0e31c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:38.603505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d298678-cedc-49f1-bb5a-0dbfc7a0e31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:38.603842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d298678-cedc-49f1-bb5a-0dbfc7a0e31c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:38.604565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d298678-cedc-49f1-bb5a-0dbfc7a0e31c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:38.606284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d298678-cedc-49f1-bb5a-0dbfc7a0e31c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:38.618929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1053/2110] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:38.623232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685d104-91da-4857-b085-173c7b21fd26 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:38.634606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685d104-91da-4857-b085-173c7b21fd26 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:38.640262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a527eea-2b29-445a-aeb9-640dfdb90dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:38.641043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a527eea-2b29-445a-aeb9-640dfdb90dcc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:38.641396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a527eea-2b29-445a-aeb9-640dfdb90dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:38.641707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a527eea-2b29-445a-aeb9-640dfdb90dcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:38.642637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a527eea-2b29-445a-aeb9-640dfdb90dcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:38.644266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a527eea-2b29-445a-aeb9-640dfdb90dcc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:38.655446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1058/2111] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:38.660112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d298678-cedc-49f1-bb5a-0dbfc7a0e31c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:38.671284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d298678-cedc-49f1-bb5a-0dbfc7a0e31c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:38.676130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ab35f-9fa3-40f8-a3a5-cc80d6e7262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:38.679357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ab35f-9fa3-40f8-a3a5-cc80d6e7262f admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:38.679357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ab35f-9fa3-40f8-a3a5-cc80d6e7262f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:38.679357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ab35f-9fa3-40f8-a3a5-cc80d6e7262f admin admin] PATH_INFO: `/v3/projects/4aa8e826d24949859aa82a3817b03c00/users/fcb03d1c7b904b36beb8bbcf8df7df7e/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:38.696005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ab35f-9fa3-40f8-a3a5-cc80d6e7262f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa8e826d24949859aa82a3817b03c00, user_id=fcb03d1c7b904b36beb8bbcf8df7df7e, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:38.699112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ab35f-9fa3-40f8-a3a5-cc80d6e7262f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:38.834243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1054/2112] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:38 2022] PUT /identity/v3/projects/4aa8e826d24949859aa82a3817b03c00/users/fcb03d1c7b904b36beb8bbcf8df7df7e/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:38.845287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ea9e-4b57-4c7b-8392-8a192b476a84 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:38.845552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ea9e-4b57-4c7b-8392-8a192b476a84 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:38.846173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621ea9e-4b57-4c7b-8392-8a192b476a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:38.886945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4621ea9e-4b57-4c7b-8392-8a192b476a84 None None] MFA Rules not processed for user `fcb03d1c7b904b36beb8bbcf8df7df7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:38.888979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4621ea9e-4b57-4c7b-8392-8a192b476a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:38.983684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1059/2113] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:38.985017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ab35f-9fa3-40f8-a3a5-cc80d6e7262f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:38.999403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:39.059013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ab35f-9fa3-40f8-a3a5-cc80d6e7262f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:39.064296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c8aab-a90e-4f71-aa5e-903be84dc122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:39.065083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c8aab-a90e-4f71-aa5e-903be84dc122 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:39.065370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c8aab-a90e-4f71-aa5e-903be84dc122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:39.065648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c8aab-a90e-4f71-aa5e-903be84dc122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:39.069783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c8aab-a90e-4f71-aa5e-903be84dc122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:39.069783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c8aab-a90e-4f71-aa5e-903be84dc122 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:39.152739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1055/2114] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:38 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:39.156939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621ea9e-4b57-4c7b-8392-8a192b476a84 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:39.171253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621ea9e-4b57-4c7b-8392-8a192b476a84 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:39.230410 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d01c8a-76b8-4d74-95e4-44a4c865f1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:39.230953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01c8a-76b8-4d74-95e4-44a4c865f1de admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:39.231243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01c8a-76b8-4d74-95e4-44a4c865f1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:39.231526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d01c8a-76b8-4d74-95e4-44a4c865f1de admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:39.232234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d01c8a-76b8-4d74-95e4-44a4c865f1de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:39.234198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d01c8a-76b8-4d74-95e4-44a4c865f1de admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:39.284227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:39.358931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1060/2115] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:39 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:39.362958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c8aab-a90e-4f71-aa5e-903be84dc122 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:39.374070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c8aab-a90e-4f71-aa5e-903be84dc122 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:39.378684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24caaf4-fd15-42da-932f-b1c6bb4318d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:39.379336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24caaf4-fd15-42da-932f-b1c6bb4318d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:39.379626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24caaf4-fd15-42da-932f-b1c6bb4318d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:39.379906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24caaf4-fd15-42da-932f-b1c6bb4318d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:39.380924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24caaf4-fd15-42da-932f-b1c6bb4318d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:39.382788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24caaf4-fd15-42da-932f-b1c6bb4318d8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:39.394682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1056/2116] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:39.399398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d01c8a-76b8-4d74-95e4-44a4c865f1de admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:39.409986 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d01c8a-76b8-4d74-95e4-44a4c865f1de admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:39.415834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c80c8-b130-4dd7-a3ae-907bb6ca3f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:39.416987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c80c8-b130-4dd7-a3ae-907bb6ca3f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:39.417337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c80c8-b130-4dd7-a3ae-907bb6ca3f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:39.417797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c80c8-b130-4dd7-a3ae-907bb6ca3f38 admin admin] PATH_INFO: `/v3/projects/6f371f7d1c42444c9440dfc22ec91fa9/users/64eea6f72ff74fa0a8d5e0e780466480/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:39.433457 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c80c8-b130-4dd7-a3ae-907bb6ca3f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f371f7d1c42444c9440dfc22ec91fa9, user_id=64eea6f72ff74fa0a8d5e0e780466480, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:39.436207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8c80c8-b130-4dd7-a3ae-907bb6ca3f38 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:39.562465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1061/2117] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:39 2022] PUT /identity/v3/projects/6f371f7d1c42444c9440dfc22ec91fa9/users/64eea6f72ff74fa0a8d5e0e780466480/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:39.564849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24caaf4-fd15-42da-932f-b1c6bb4318d8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:39.575886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24caaf4-fd15-42da-932f-b1c6bb4318d8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:39.657564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954bb47-c464-4c01-9b72-052bcfabf0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:39.658466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954bb47-c464-4c01-9b72-052bcfabf0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:39.658816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954bb47-c464-4c01-9b72-052bcfabf0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:39.659165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954bb47-c464-4c01-9b72-052bcfabf0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:39.660041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954bb47-c464-4c01-9b72-052bcfabf0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:39.662020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954bb47-c464-4c01-9b72-052bcfabf0c0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:39.675134 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1057/2118] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:39.681063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c80c8-b130-4dd7-a3ae-907bb6ca3f38 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:39.693432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c80c8-b130-4dd7-a3ae-907bb6ca3f38 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:39.703388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd389-ce98-46e6-bc23-3d7e6228137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:39.705608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd389-ce98-46e6-bc23-3d7e6228137f admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:39.706264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd389-ce98-46e6-bc23-3d7e6228137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:39.706770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529dd389-ce98-46e6-bc23-3d7e6228137f admin admin] PATH_INFO: `/v3/projects/6f371f7d1c42444c9440dfc22ec91fa9/users/64eea6f72ff74fa0a8d5e0e780466480/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:39.710359 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dd389-ce98-46e6-bc23-3d7e6228137f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f371f7d1c42444c9440dfc22ec91fa9, user_id=64eea6f72ff74fa0a8d5e0e780466480, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:39.715255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529dd389-ce98-46e6-bc23-3d7e6228137f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:39.732947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1062/2119] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:39 2022] PUT /identity/v3/projects/6f371f7d1c42444c9440dfc22ec91fa9/users/64eea6f72ff74fa0a8d5e0e780466480/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:39.753228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9a96-8f72-45ac-9b0f-1dcf2be260f8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:39.753436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9a96-8f72-45ac-9b0f-1dcf2be260f8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:39.753751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e9a96-8f72-45ac-9b0f-1dcf2be260f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:39.789276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b83e9a96-8f72-45ac-9b0f-1dcf2be260f8 None None] MFA Rules not processed for user `64eea6f72ff74fa0a8d5e0e780466480`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:39.790795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b83e9a96-8f72-45ac-9b0f-1dcf2be260f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:39.867889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1058/2120] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:40.091183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd389-ce98-46e6-bc23-3d7e6228137f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:40.093127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-529dd389-ce98-46e6-bc23-3d7e6228137f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:40.158260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529dd389-ce98-46e6-bc23-3d7e6228137f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:40.162213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cccc60-6acd-4b4a-9bce-7dad77a35e47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:40.162733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cccc60-6acd-4b4a-9bce-7dad77a35e47 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:40.163022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cccc60-6acd-4b4a-9bce-7dad77a35e47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:40.163344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cccc60-6acd-4b4a-9bce-7dad77a35e47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:40.227170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cccc60-6acd-4b4a-9bce-7dad77a35e47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:40.228617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cccc60-6acd-4b4a-9bce-7dad77a35e47 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:40.237600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1063/2121] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:41.644887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:41.913150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:42.579297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e9a96-8f72-45ac-9b0f-1dcf2be260f8 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:42.580874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b83e9a96-8f72-45ac-9b0f-1dcf2be260f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:42.678414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e9a96-8f72-45ac-9b0f-1dcf2be260f8 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:42.685431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:42.686491 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:42.686814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:42.687503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] PATH_INFO: `/v3/users/e4dc03126f644e3c92c0a195978f7010` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:42.688806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4dc03126f644e3c92c0a195978f7010)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:42.691647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:42.928602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4dc03126f644e3c92c0a195978f7010'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:42.951226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:42.959388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cccc60-6acd-4b4a-9bce-7dad77a35e47 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:42.960824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f5cccc60-6acd-4b4a-9bce-7dad77a35e47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:42.972169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cccc60-6acd-4b4a-9bce-7dad77a35e47 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:42.977785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7595d16-ac86-421b-b63c-925c9ff1ab88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:42.978456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595d16-ac86-421b-b63c-925c9ff1ab88 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:42.978748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595d16-ac86-421b-b63c-925c9ff1ab88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:42.979028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7595d16-ac86-421b-b63c-925c9ff1ab88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.003413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4dc03126f644e3c92c0a195978f7010'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:43.004078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4dc03126f644e3c92c0a195978f7010'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:43.004709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4dc03126f644e3c92c0a195978f7010'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:43.019580 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-0bde242a-8bf1-4dca-b176-d09e39363ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4dc03126f644e3c92c0a195978f7010'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:43.035678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1059/2122] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:42 2022] DELETE /identity/v3/users/e4dc03126f644e3c92c0a195978f7010 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:43.041264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8849a-4604-4316-866b-4b914c25dd5f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:43.041561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8849a-4604-4316-866b-4b914c25dd5f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:43.041882 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8849a-4604-4316-866b-4b914c25dd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.059812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7595d16-ac86-421b-b63c-925c9ff1ab88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:43.061602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7595d16-ac86-421b-b63c-925c9ff1ab88 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:43.062079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8bd8849a-4604-4316-866b-4b914c25dd5f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:43.063459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8bd8849a-4604-4316-866b-4b914c25dd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.072366 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1064/2123] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:43.139857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1060/2124] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:43.151497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7595d16-ac86-421b-b63c-925c9ff1ab88 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:43.154154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c7595d16-ac86-421b-b63c-925c9ff1ab88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.227305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7595d16-ac86-421b-b63c-925c9ff1ab88 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:43.282934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70427a93-b5a9-4f2a-91f1-6326fe3c7a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:43.283599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427a93-b5a9-4f2a-91f1-6326fe3c7a80 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:43.283888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427a93-b5a9-4f2a-91f1-6326fe3c7a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:43.284163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70427a93-b5a9-4f2a-91f1-6326fe3c7a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.296486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70427a93-b5a9-4f2a-91f1-6326fe3c7a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:43.298135 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70427a93-b5a9-4f2a-91f1-6326fe3c7a80 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:43.311373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1065/2125] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:43.369503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:43.890207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8849a-4604-4316-866b-4b914c25dd5f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:43.891739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8bd8849a-4604-4316-866b-4b914c25dd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.904514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8849a-4604-4316-866b-4b914c25dd5f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:43.912882 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:43.919238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:43.919238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:43.919238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] PATH_INFO: `/v3/projects/2d7c11402fa94737be3e05efa24a8808` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.919238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7c11402fa94737be3e05efa24a8808)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:43.919238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:43.941703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70427a93-b5a9-4f2a-91f1-6326fe3c7a80 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:43.943706 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-70427a93-b5a9-4f2a-91f1-6326fe3c7a80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.957896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70427a93-b5a9-4f2a-91f1-6326fe3c7a80 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:43.963032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:43.963960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:43.964233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:43.964515 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] PATH_INFO: `/v3/users/e105a6165cdb4befabab5b2c03af8fe6` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.965789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e105a6165cdb4befabab5b2c03af8fe6)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:43.967930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:44.123899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7c11402fa94737be3e05efa24a8808', 'request_id': 'req-537b9e77-1433-4140-a43c-b226207d80db'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:44.129266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7c11402fa94737be3e05efa24a8808', 'request_id': 'req-537b9e77-1433-4140-a43c-b226207d80db'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:44.136723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7c11402fa94737be3e05efa24a8808', 'request_id': 'req-537b9e77-1433-4140-a43c-b226207d80db'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:44.312785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:44.331049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e105a6165cdb4befabab5b2c03af8fe6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:44.332046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] The token cache is being invalidate because project 2d7c11402fa94737be3e05efa24a8808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:44.332348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:44.333046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-537b9e77-1433-4140-a43c-b226207d80db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:44.335928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e105a6165cdb4befabab5b2c03af8fe6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:44.336085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1061/2126] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:43 2022] DELETE /identity/v3/projects/2d7c11402fa94737be3e05efa24a8808 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:44.341717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debb212-453b-43a6-b000-0fc631e662b9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.342003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debb212-453b-43a6-b000-0fc631e662b9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.342285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debb212-453b-43a6-b000-0fc631e662b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.360570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9debb212-453b-43a6-b000-0fc631e662b9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:44.362450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9debb212-453b-43a6-b000-0fc631e662b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:44.427690 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1062/2127] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:44.436694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1978e-a5b1-44bc-bd68-822ede412608 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.436982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1978e-a5b1-44bc-bd68-822ede412608 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.437328 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1978e-a5b1-44bc-bd68-822ede412608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.449780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e105a6165cdb4befabab5b2c03af8fe6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:44.450066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e105a6165cdb4befabab5b2c03af8fe6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:44.456974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6dc1978e-a5b1-44bc-bd68-822ede412608 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:44.458255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6dc1978e-a5b1-44bc-bd68-822ede412608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:44.463797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3178206c-7c0a-4907-a722-22f64fb1d8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e105a6165cdb4befabab5b2c03af8fe6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:44.466581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1063/2128] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:44.471635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1978e-a5b1-44bc-bd68-822ede412608 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:44.481995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1066/2129] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:43 2022] DELETE /identity/v3/users/e105a6165cdb4befabab5b2c03af8fe6 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:44.483642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ac1a0-967c-4d56-b49d-99c867841402 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.483960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ac1a0-967c-4d56-b49d-99c867841402 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.486354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ac1a0-967c-4d56-b49d-99c867841402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.493393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1978e-a5b1-44bc-bd68-822ede412608 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:44.504253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d04ac1a0-967c-4d56-b49d-99c867841402 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:44.505479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d04ac1a0-967c-4d56-b49d-99c867841402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:44.554921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaedf8-b490-4ebb-982c-6f85cc86a360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:44.555683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaedf8-b490-4ebb-982c-6f85cc86a360 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.555974 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaedf8-b490-4ebb-982c-6f85cc86a360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.556259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aaedf8-b490-4ebb-982c-6f85cc86a360 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.557363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaedf8-b490-4ebb-982c-6f85cc86a360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:44.557705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaedf8-b490-4ebb-982c-6f85cc86a360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:44.560869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aaedf8-b490-4ebb-982c-6f85cc86a360 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:44.570711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1067/2130] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:44.573947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1064/2131] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:47:44.578314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ac1a0-967c-4d56-b49d-99c867841402 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:44.580856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaedf8-b490-4ebb-982c-6f85cc86a360 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:44.582674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-88aaedf8-b490-4ebb-982c-6f85cc86a360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:44.589180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ac1a0-967c-4d56-b49d-99c867841402 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:44.594746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a89a0-603c-4ce5-a409-ca6d6b65b2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:44.595424 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a89a0-603c-4ce5-a409-ca6d6b65b2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.595864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a89a0-603c-4ce5-a409-ca6d6b65b2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.596151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a89a0-603c-4ce5-a409-ca6d6b65b2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.596866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a89a0-603c-4ce5-a409-ca6d6b65b2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:44.599330 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a89a0-603c-4ce5-a409-ca6d6b65b2e4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:44.651091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aaedf8-b490-4ebb-982c-6f85cc86a360 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:44.655835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d89b81-0ac8-4d51-8d99-8bb7f9fe4a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:44.656678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d89b81-0ac8-4d51-8d99-8bb7f9fe4a18 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.656877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d89b81-0ac8-4d51-8d99-8bb7f9fe4a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.657210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d89b81-0ac8-4d51-8d99-8bb7f9fe4a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.670011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d89b81-0ac8-4d51-8d99-8bb7f9fe4a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:44.671524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d89b81-0ac8-4d51-8d99-8bb7f9fe4a18 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:44.685779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1065/2132] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:44.691999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1068/2133] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:44 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:44.693025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d89b81-0ac8-4d51-8d99-8bb7f9fe4a18 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:44.706284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d89b81-0ac8-4d51-8d99-8bb7f9fe4a18 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:44.788699 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83035ec5-6ebe-4b58-a5cd-84653802c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:44.789332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83035ec5-6ebe-4b58-a5cd-84653802c9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.789617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83035ec5-6ebe-4b58-a5cd-84653802c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.790138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83035ec5-6ebe-4b58-a5cd-84653802c9c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.790847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83035ec5-6ebe-4b58-a5cd-84653802c9c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:44.792810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83035ec5-6ebe-4b58-a5cd-84653802c9c2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:44.919960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1066/2134] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:44 2022] POST /identity/v3/users => generated 300 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:44.922962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a89a0-603c-4ce5-a409-ca6d6b65b2e4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:44.937471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a89a0-603c-4ce5-a409-ca6d6b65b2e4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:44.949065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2cdd9-e433-48b5-8fe9-97869a84bf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:44.954138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2cdd9-e433-48b5-8fe9-97869a84bf4d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.954138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2cdd9-e433-48b5-8fe9-97869a84bf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.954138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a2cdd9-e433-48b5-8fe9-97869a84bf4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.954138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2cdd9-e433-48b5-8fe9-97869a84bf4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:44.954138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a2cdd9-e433-48b5-8fe9-97869a84bf4d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:44.970373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1069/2135] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:44.971770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83035ec5-6ebe-4b58-a5cd-84653802c9c2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:44.993541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83035ec5-6ebe-4b58-a5cd-84653802c9c2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:45.002149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32867408-fb45-41e2-ab88-2bae1f85003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:45.003837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32867408-fb45-41e2-ab88-2bae1f85003a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:45.004755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32867408-fb45-41e2-ab88-2bae1f85003a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:45.005641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32867408-fb45-41e2-ab88-2bae1f85003a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:45.008496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32867408-fb45-41e2-ab88-2bae1f85003a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:45.011812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32867408-fb45-41e2-ab88-2bae1f85003a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:45.028169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1067/2136] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:45.033580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2cdd9-e433-48b5-8fe9-97869a84bf4d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:45.051018 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a2cdd9-e433-48b5-8fe9-97869a84bf4d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:45.060824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744b9f-9eb5-47c4-bb69-7be340a07848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:45.062377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744b9f-9eb5-47c4-bb69-7be340a07848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:45.063043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744b9f-9eb5-47c4-bb69-7be340a07848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:45.063326 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5744b9f-9eb5-47c4-bb69-7be340a07848 admin admin] PATH_INFO: `/v3/projects/a797a057ea1d48a2a8532439a9968787/users/b586f7709d4e44f19fd3c3c17d1cae0b/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:45.073733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:45.091954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5744b9f-9eb5-47c4-bb69-7be340a07848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a797a057ea1d48a2a8532439a9968787, user_id=b586f7709d4e44f19fd3c3c17d1cae0b, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:45.097095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5744b9f-9eb5-47c4-bb69-7be340a07848 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:45.244166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1070/2137] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:45 2022] PUT /identity/v3/projects/a797a057ea1d48a2a8532439a9968787/users/b586f7709d4e44f19fd3c3c17d1cae0b/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:45.256686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dc5f8-f528-4c25-a471-b9c4a390a1da None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:45.256983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dc5f8-f528-4c25-a471-b9c4a390a1da None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:45.257262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2dc5f8-f528-4c25-a471-b9c4a390a1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:45.299410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ea2dc5f8-f528-4c25-a471-b9c4a390a1da None None] MFA Rules not processed for user `b586f7709d4e44f19fd3c3c17d1cae0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:45.301317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ea2dc5f8-f528-4c25-a471-b9c4a390a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:45.310355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744b9f-9eb5-47c4-bb69-7be340a07848 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:45.314202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b5744b9f-9eb5-47c4-bb69-7be340a07848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:45.408352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1068/2138] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:45 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:45.436082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5744b9f-9eb5-47c4-bb69-7be340a07848 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:45.449211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:45.450007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2dc5f8-f528-4c25-a471-b9c4a390a1da None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:45.450139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:45.450428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:45.450923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] PATH_INFO: `/v3/projects/8e13fd94e9d94004aae0ae93c0dcb2a8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:45.451344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ea2dc5f8-f528-4c25-a471-b9c4a390a1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:45.452447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e13fd94e9d94004aae0ae93c0dcb2a8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:45.454572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:45.526575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2dc5f8-f528-4c25-a471-b9c4a390a1da None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:45.530498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c237b9-dd91-4b4d-a0cf-f4cf59de4c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:45.531161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c237b9-dd91-4b4d-a0cf-f4cf59de4c02 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:45.531458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c237b9-dd91-4b4d-a0cf-f4cf59de4c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:45.532120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c237b9-dd91-4b4d-a0cf-f4cf59de4c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:45.542874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c237b9-dd91-4b4d-a0cf-f4cf59de4c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:45.549024 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c237b9-dd91-4b4d-a0cf-f4cf59de4c02 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:45.559534 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1069/2139] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:45.599119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e13fd94e9d94004aae0ae93c0dcb2a8', 'request_id': 'req-d8a8b503-ee2c-438d-860b-2694a2e7db47'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:45.606920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e13fd94e9d94004aae0ae93c0dcb2a8', 'request_id': 'req-d8a8b503-ee2c-438d-860b-2694a2e7db47'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:45.613335 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e13fd94e9d94004aae0ae93c0dcb2a8', 'request_id': 'req-d8a8b503-ee2c-438d-860b-2694a2e7db47'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:45.693610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] The token cache is being invalidate because project 8e13fd94e9d94004aae0ae93c0dcb2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:45.693954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:45.695108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:45.697442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1071/2140] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:45 2022] DELETE /identity/v3/projects/8e13fd94e9d94004aae0ae93c0dcb2a8 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:45.701202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c237b9-dd91-4b4d-a0cf-f4cf59de4c02 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:45.708981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:45.711574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:45.713819 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c237b9-dd91-4b4d-a0cf-f4cf59de4c02 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:45.776509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a8b503-ee2c-438d-860b-2694a2e7db47 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:45.785550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6481-d6e0-406b-a380-b2d529b5f405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:45.786283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6481-d6e0-406b-a380-b2d529b5f405 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:45.786590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6481-d6e0-406b-a380-b2d529b5f405 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:45.786904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab6481-d6e0-406b-a380-b2d529b5f405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:45.788744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c9ab6481-d6e0-406b-a380-b2d529b5f405 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:45.790713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:45.791599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:45.791887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:45.792169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] PATH_INFO: `/v3/users/dc7ab574337247d99e2ccd42c412a1da` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:45.793373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc7ab574337247d99e2ccd42c412a1da)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:45.795329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:45.868312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab6481-d6e0-406b-a380-b2d529b5f405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:45.870906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab6481-d6e0-406b-a380-b2d529b5f405 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:45.888498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1072/2141] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:46.057779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc7ab574337247d99e2ccd42c412a1da'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:46.066536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:46.182055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc7ab574337247d99e2ccd42c412a1da'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:46.183333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc7ab574337247d99e2ccd42c412a1da'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:46.184227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc7ab574337247d99e2ccd42c412a1da'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:46.220012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3ee83f0b-959e-4f55-b321-441213d0be96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc7ab574337247d99e2ccd42c412a1da'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:46.238267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1070/2142] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:45 2022] DELETE /identity/v3/users/dc7ab574337247d99e2ccd42c412a1da => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:46.783084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:46.792455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6481-d6e0-406b-a380-b2d529b5f405 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:46.794061 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c9ab6481-d6e0-406b-a380-b2d529b5f405 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:46.812854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab6481-d6e0-406b-a380-b2d529b5f405 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:46.884224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:46.885143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:46.885426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:46.885728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] PATH_INFO: `/v3/projects/82e6a0e5f6c348c7a9c7518b2e6c8474` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:46.886966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e6a0e5f6c348c7a9c7518b2e6c8474)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:46.888905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:47.033069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e6a0e5f6c348c7a9c7518b2e6c8474', 'request_id': 'req-7c5ab86c-347e-4dc4-84b7-387471d155b6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:47.042693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e6a0e5f6c348c7a9c7518b2e6c8474', 'request_id': 'req-7c5ab86c-347e-4dc4-84b7-387471d155b6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:47.049229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e6a0e5f6c348c7a9c7518b2e6c8474', 'request_id': 'req-7c5ab86c-347e-4dc4-84b7-387471d155b6'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:47.312867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] The token cache is being invalidate because project 82e6a0e5f6c348c7a9c7518b2e6c8474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:47.313165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:47.314833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7c5ab86c-347e-4dc4-84b7-387471d155b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:47.318042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1073/2143] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:46 2022] DELETE /identity/v3/projects/82e6a0e5f6c348c7a9c7518b2e6c8474 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:47.329768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88194e52-f018-47e9-bd9a-e489a6d5cdcb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:47.331189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88194e52-f018-47e9-bd9a-e489a6d5cdcb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:47.331715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88194e52-f018-47e9-bd9a-e489a6d5cdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:47.352893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-88194e52-f018-47e9-bd9a-e489a6d5cdcb None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:47.354186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-88194e52-f018-47e9-bd9a-e489a6d5cdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:47.418126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1071/2144] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:47.426250 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8144661-c2ee-4f59-a8d9-5da5cf140ca9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:47.426569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8144661-c2ee-4f59-a8d9-5da5cf140ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:47.426872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8144661-c2ee-4f59-a8d9-5da5cf140ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:47.447489 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e8144661-c2ee-4f59-a8d9-5da5cf140ca9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:47.448732 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e8144661-c2ee-4f59-a8d9-5da5cf140ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:47.459100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1074/2145] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:47.463247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88194e52-f018-47e9-bd9a-e489a6d5cdcb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:47.474059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88194e52-f018-47e9-bd9a-e489a6d5cdcb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:47.481626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfc40c-8c07-43c5-8ba8-1773616e923a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:47.482472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc40c-8c07-43c5-8ba8-1773616e923a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:47.482839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc40c-8c07-43c5-8ba8-1773616e923a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:47.483170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc40c-8c07-43c5-8ba8-1773616e923a admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:47.486872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfc40c-8c07-43c5-8ba8-1773616e923a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:47.486872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfc40c-8c07-43c5-8ba8-1773616e923a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:47.486872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfc40c-8c07-43c5-8ba8-1773616e923a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:47.506536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1072/2146] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:47:47.511703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8144661-c2ee-4f59-a8d9-5da5cf140ca9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:47.533035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8144661-c2ee-4f59-a8d9-5da5cf140ca9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:47.533625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c1ea-c1d0-4a31-a270-7e6c8dbdf844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:47.534325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c1ea-c1d0-4a31-a270-7e6c8dbdf844 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:47.534613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c1ea-c1d0-4a31-a270-7e6c8dbdf844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:47.534918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9c1ea-c1d0-4a31-a270-7e6c8dbdf844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:47.535679 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9c1ea-c1d0-4a31-a270-7e6c8dbdf844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:47.537603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9c1ea-c1d0-4a31-a270-7e6c8dbdf844 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:47.659137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1075/2147] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:47 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:47.664774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfc40c-8c07-43c5-8ba8-1773616e923a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:47.676395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfc40c-8c07-43c5-8ba8-1773616e923a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:47.738855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68f462-7ebb-4f80-b928-1a24c1bf856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:47.739537 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f462-7ebb-4f80-b928-1a24c1bf856b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:47.739830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f462-7ebb-4f80-b928-1a24c1bf856b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:47.740113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68f462-7ebb-4f80-b928-1a24c1bf856b admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:47.740810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68f462-7ebb-4f80-b928-1a24c1bf856b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:47.743423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68f462-7ebb-4f80-b928-1a24c1bf856b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:47.875254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1073/2148] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:47:47 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:47.876631 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c1ea-c1d0-4a31-a270-7e6c8dbdf844 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:47.888024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9c1ea-c1d0-4a31-a270-7e6c8dbdf844 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:47.893646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587d4ed-1d7b-4b9d-bd43-1066cd98ac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:47.894603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587d4ed-1d7b-4b9d-bd43-1066cd98ac42 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:47.897990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587d4ed-1d7b-4b9d-bd43-1066cd98ac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:47.898448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587d4ed-1d7b-4b9d-bd43-1066cd98ac42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:47.899343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587d4ed-1d7b-4b9d-bd43-1066cd98ac42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:47.903541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587d4ed-1d7b-4b9d-bd43-1066cd98ac42 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:47.916394 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1076/2149] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:47.920025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68f462-7ebb-4f80-b928-1a24c1bf856b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:47.933446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68f462-7ebb-4f80-b928-1a24c1bf856b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:47.946860 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07f9fe-a7e4-450d-8363-9065fe71440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:47.947704 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07f9fe-a7e4-450d-8363-9065fe71440a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:47.948045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07f9fe-a7e4-450d-8363-9065fe71440a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:47.948380 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07f9fe-a7e4-450d-8363-9065fe71440a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:47.949723 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07f9fe-a7e4-450d-8363-9065fe71440a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:47.951199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07f9fe-a7e4-450d-8363-9065fe71440a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:47.971727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1074/2150] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:47.981946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587d4ed-1d7b-4b9d-bd43-1066cd98ac42 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:47.993078 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587d4ed-1d7b-4b9d-bd43-1066cd98ac42 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:47.997895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981ad92-5f36-48fd-aa08-000dcb4729db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:47.998789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981ad92-5f36-48fd-aa08-000dcb4729db admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:47.999099 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981ad92-5f36-48fd-aa08-000dcb4729db admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:47.999379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981ad92-5f36-48fd-aa08-000dcb4729db admin admin] PATH_INFO: `/v3/projects/3f6697bc978547658eac29120ab7745e/users/502a6e647897409997288d03ced1c5a3/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:48.019531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981ad92-5f36-48fd-aa08-000dcb4729db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f6697bc978547658eac29120ab7745e, user_id=502a6e647897409997288d03ced1c5a3, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:48.022836 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981ad92-5f36-48fd-aa08-000dcb4729db admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:48.065378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:48.185723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:48.194181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1077/2151] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:47:47 2022] PUT /identity/v3/projects/3f6697bc978547658eac29120ab7745e/users/502a6e647897409997288d03ced1c5a3/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:48.206374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5016142-191d-4218-bf57-efe28b067a0b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:48.206916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5016142-191d-4218-bf57-efe28b067a0b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:48.207338 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5016142-191d-4218-bf57-efe28b067a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:48.249422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-c5016142-191d-4218-bf57-efe28b067a0b None None] MFA Rules not processed for user `502a6e647897409997288d03ced1c5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:48.251001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c5016142-191d-4218-bf57-efe28b067a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:48.340853 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1075/2152] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:48.356065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981ad92-5f36-48fd-aa08-000dcb4729db admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:48.358085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b981ad92-5f36-48fd-aa08-000dcb4729db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:48.429234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981ad92-5f36-48fd-aa08-000dcb4729db admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:48.433922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff5b2b-0fa9-495c-9134-b78cfeb49a0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:48.434589 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5b2b-0fa9-495c-9134-b78cfeb49a0b service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:48.434875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5b2b-0fa9-495c-9134-b78cfeb49a0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:48.435151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff5b2b-0fa9-495c-9134-b78cfeb49a0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:48.446449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff5b2b-0fa9-495c-9134-b78cfeb49a0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:48.447852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff5b2b-0fa9-495c-9134-b78cfeb49a0b service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:48.457633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1078/2153] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:48.482976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5016142-191d-4218-bf57-efe28b067a0b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:48.557877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5016142-191d-4218-bf57-efe28b067a0b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:48.563685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:48.564464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:48.565471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:48.565471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] PATH_INFO: `/v3/users/502a6e647897409997288d03ced1c5a3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:48.566335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=502a6e647897409997288d03ced1c5a3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:48.568514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:48.830043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '502a6e647897409997288d03ced1c5a3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:48.947132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '502a6e647897409997288d03ced1c5a3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:48.947769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '502a6e647897409997288d03ced1c5a3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:48.948508 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '502a6e647897409997288d03ced1c5a3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:48.961792 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '502a6e647897409997288d03ced1c5a3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:48.977919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1076/2154] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:48 2022] DELETE /identity/v3/users/502a6e647897409997288d03ced1c5a3 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:48.979758 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd54dcc-4c1f-463a-b499-66788ed705f9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:48.980261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd54dcc-4c1f-463a-b499-66788ed705f9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:48.983114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd54dcc-4c1f-463a-b499-66788ed705f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:49.003287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-afd54dcc-4c1f-463a-b499-66788ed705f9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:49.004704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-afd54dcc-4c1f-463a-b499-66788ed705f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:49.092110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1079/2155] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:49.101442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:49.103066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:49.168660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc8358-020c-4801-8df3-f5ef368ee224 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:49.172709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e292f-88b0-4ce9-ac52-49cca91e9c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:49.173382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e292f-88b0-4ce9-ac52-49cca91e9c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:49.173686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e292f-88b0-4ce9-ac52-49cca91e9c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:49.174221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e292f-88b0-4ce9-ac52-49cca91e9c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:49.185080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e292f-88b0-4ce9-ac52-49cca91e9c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:49.186508 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e292f-88b0-4ce9-ac52-49cca91e9c84 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:49.200066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1077/2156] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:49.524831 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:49.712366 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd54dcc-4c1f-463a-b499-66788ed705f9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:49.714411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-afd54dcc-4c1f-463a-b499-66788ed705f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:49.727243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd54dcc-4c1f-463a-b499-66788ed705f9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:49.736690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:49.737705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:49.737892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:49.738176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] PATH_INFO: `/v3/projects/3f6697bc978547658eac29120ab7745e` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:49.739541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f6697bc978547658eac29120ab7745e)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:49.742124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:49.909588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f6697bc978547658eac29120ab7745e', 'request_id': 'req-c3e68f33-6000-4ae5-92a8-16b858c7de96'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:49.919185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f6697bc978547658eac29120ab7745e', 'request_id': 'req-c3e68f33-6000-4ae5-92a8-16b858c7de96'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:49.925960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f6697bc978547658eac29120ab7745e', 'request_id': 'req-c3e68f33-6000-4ae5-92a8-16b858c7de96'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:49.976641 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:50.048840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] The token cache is being invalidate because project 3f6697bc978547658eac29120ab7745e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:50.049424 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:50.049777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c3e68f33-6000-4ae5-92a8-16b858c7de96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:50.051383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1080/2157] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:49 2022] DELETE /identity/v3/projects/3f6697bc978547658eac29120ab7745e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:50.479498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:50.679225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:50.894935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:51.164381 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:51.632418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:51.712555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=83,keystone:INSERT=4,keystone:DELETE=13 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:51.975481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:52.032755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:52.518363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:52.552253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:52.593030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:52.713783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:52.878272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:53.080092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:53.158208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:53.712849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:53.821607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:54.480961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e292f-88b0-4ce9-ac52-49cca91e9c84 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:54.482657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e14e292f-88b0-4ce9-ac52-49cca91e9c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:54.498269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e292f-88b0-4ce9-ac52-49cca91e9c84 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:54.527715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:54.561436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:54.562394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:54.562678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:54.562954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] PATH_INFO: `/v3/users/d3ee53570e5e4bff9aba3ad5c338da34` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:54.564196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ee53570e5e4bff9aba3ad5c338da34)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:54.566410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:54.657086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:54.795947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ee53570e5e4bff9aba3ad5c338da34'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:55.029019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ee53570e5e4bff9aba3ad5c338da34'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:55.030374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ee53570e5e4bff9aba3ad5c338da34'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:55.031582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ee53570e5e4bff9aba3ad5c338da34'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:55.054588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ee53570e5e4bff9aba3ad5c338da34'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:55.070018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1078/2158] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:54 2022] DELETE /identity/v3/users/d3ee53570e5e4bff9aba3ad5c338da34 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:55.074795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382cb21-53c8-479d-a58f-57791fd3bd4f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:55.075208 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382cb21-53c8-479d-a58f-57791fd3bd4f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:55.075587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382cb21-53c8-479d-a58f-57791fd3bd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:55.100055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1382cb21-53c8-479d-a58f-57791fd3bd4f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:55.103390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1382cb21-53c8-479d-a58f-57791fd3bd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:55.178044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1081/2159] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:55.192613 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:55.198051 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:55.267946 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7a88a-a6e9-405a-b97d-6daab1610830 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:55.271616 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95025e97-ba2d-4b10-b2fa-435b3f4ffe75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:55.272295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025e97-ba2d-4b10-b2fa-435b3f4ffe75 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:55.273127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025e97-ba2d-4b10-b2fa-435b3f4ffe75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:55.273406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95025e97-ba2d-4b10-b2fa-435b3f4ffe75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:55.284086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95025e97-ba2d-4b10-b2fa-435b3f4ffe75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:55.285488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95025e97-ba2d-4b10-b2fa-435b3f4ffe75 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:55.295148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1079/2160] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:55.638491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:55.728218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:55.771292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382cb21-53c8-479d-a58f-57791fd3bd4f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:55.772848 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1382cb21-53c8-479d-a58f-57791fd3bd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:55.798612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382cb21-53c8-479d-a58f-57791fd3bd4f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:55.810753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:55.811729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:55.811925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:55.812556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] PATH_INFO: `/v3/projects/be74ce70a7ca4c6b9c499703c96da9c1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:55.815363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be74ce70a7ca4c6b9c499703c96da9c1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:55.817603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:55.985989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be74ce70a7ca4c6b9c499703c96da9c1', 'request_id': 'req-c87c9d32-56fe-49b3-a8c0-802c868e8159'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:55.992493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be74ce70a7ca4c6b9c499703c96da9c1', 'request_id': 'req-c87c9d32-56fe-49b3-a8c0-802c868e8159'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:55.999297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be74ce70a7ca4c6b9c499703c96da9c1', 'request_id': 'req-c87c9d32-56fe-49b3-a8c0-802c868e8159'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.089580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] The token cache is being invalidate because project be74ce70a7ca4c6b9c499703c96da9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:56.089993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.090632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.092239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1082/2161] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:55 2022] DELETE /identity/v3/projects/be74ce70a7ca4c6b9c499703c96da9c1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:56.096243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95025e97-ba2d-4b10-b2fa-435b3f4ffe75 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:56.108827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95025e97-ba2d-4b10-b2fa-435b3f4ffe75 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:56.168143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:56.169059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:56.169344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:56.169624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] PATH_INFO: `/v3/users/fcb03d1c7b904b36beb8bbcf8df7df7e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:56.170898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb03d1c7b904b36beb8bbcf8df7df7e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:56.182471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:56.204035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:56.295901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:56.391047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb03d1c7b904b36beb8bbcf8df7df7e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.472190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb03d1c7b904b36beb8bbcf8df7df7e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.472875 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb03d1c7b904b36beb8bbcf8df7df7e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.473853 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb03d1c7b904b36beb8bbcf8df7df7e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.488232 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb03d1c7b904b36beb8bbcf8df7df7e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.500649 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1080/2162] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:56 2022] DELETE /identity/v3/users/fcb03d1c7b904b36beb8bbcf8df7df7e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:56.807934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:56.870566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:56.872235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:56.885858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87c9d32-56fe-49b3-a8c0-802c868e8159 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:56.956939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:56.964826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:56.966808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:56.968136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:56.971700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:56.972150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:56.972442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] PATH_INFO: `/v3/users/b586f7709d4e44f19fd3c3c17d1cae0b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:56.973820 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b586f7709d4e44f19fd3c3c17d1cae0b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:56.976175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:56.982778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b0104-1feb-4c14-8ec7-8716151ed970 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:56.989949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:56.991108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:56.991517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:56.991891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] PATH_INFO: `/v3/projects/4aa8e826d24949859aa82a3817b03c00` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:56.993378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa8e826d24949859aa82a3817b03c00)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:56.995731 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:57.072118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:57.307718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b586f7709d4e44f19fd3c3c17d1cae0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.308390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b586f7709d4e44f19fd3c3c17d1cae0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.314455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa8e826d24949859aa82a3817b03c00', 'request_id': 'req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.320997 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa8e826d24949859aa82a3817b03c00', 'request_id': 'req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.328175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa8e826d24949859aa82a3817b03c00', 'request_id': 'req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.383768 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b586f7709d4e44f19fd3c3c17d1cae0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.384455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b586f7709d4e44f19fd3c3c17d1cae0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.397874 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-81317b03-c7cf-4243-acaf-fa3e1ce54bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b586f7709d4e44f19fd3c3c17d1cae0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.416650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1083/2163] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:56 2022] DELETE /identity/v3/users/b586f7709d4e44f19fd3c3c17d1cae0b => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:57.418740 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ae49-a0b4-48d4-a042-d5791c6029fd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:57.419154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ae49-a0b4-48d4-a042-d5791c6029fd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:57.419707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ae49-a0b4-48d4-a042-d5791c6029fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:57.439878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-36a2ae49-a0b4-48d4-a042-d5791c6029fd None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:57.441156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-36a2ae49-a0b4-48d4-a042-d5791c6029fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:57.495880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:57.505727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] The token cache is being invalidate because project 4aa8e826d24949859aa82a3817b03c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:57.506287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.506957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.509816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1081/2164] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:56 2022] DELETE /identity/v3/projects/4aa8e826d24949859aa82a3817b03c00 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:57.515556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:57.516752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:57.541096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1084/2165] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:57.548312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ae49-a0b4-48d4-a042-d5791c6029fd None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:57.550060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-36a2ae49-a0b4-48d4-a042-d5791c6029fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:57.620894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ae49-a0b4-48d4-a042-d5791c6029fd None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:57.623867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0663f4-d97f-4cdd-849f-bc26f3ed4dac admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:57.626105 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371b8b2-9463-4607-b57d-fff4789f398e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:57.626783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b8b2-9463-4607-b57d-fff4789f398e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:57.627224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b8b2-9463-4607-b57d-fff4789f398e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:57.627510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b8b2-9463-4607-b57d-fff4789f398e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:57.629867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:57.631499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:57.632318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:57.632831 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] PATH_INFO: `/v3/users/64eea6f72ff74fa0a8d5e0e780466480` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:57.636157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64eea6f72ff74fa0a8d5e0e780466480)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:57.638498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:57.639947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371b8b2-9463-4607-b57d-fff4789f398e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:57.641198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e371b8b2-9463-4607-b57d-fff4789f398e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:57.648957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:57.656247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1085/2166] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:57.872680 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371b8b2-9463-4607-b57d-fff4789f398e service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:57.874175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e371b8b2-9463-4607-b57d-fff4789f398e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:57.887311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e371b8b2-9463-4607-b57d-fff4789f398e service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:57.892138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:57.893034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:57.893316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:57.893591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] PATH_INFO: `/v3/users/bb3f105073184b5c8f57a208c29e87c8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:57.894847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb3f105073184b5c8f57a208c29e87c8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:57.896815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:57.919217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:58.166774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64eea6f72ff74fa0a8d5e0e780466480'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.300883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64eea6f72ff74fa0a8d5e0e780466480'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.301456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64eea6f72ff74fa0a8d5e0e780466480'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.302163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64eea6f72ff74fa0a8d5e0e780466480'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.315889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb3f105073184b5c8f57a208c29e87c8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.316560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64eea6f72ff74fa0a8d5e0e780466480'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.317036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb3f105073184b5c8f57a208c29e87c8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.329992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1082/2167] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:57 2022] DELETE /identity/v3/users/64eea6f72ff74fa0a8d5e0e780466480 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:58.440850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:58.442548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:58.477775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb3f105073184b5c8f57a208c29e87c8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.478435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb3f105073184b5c8f57a208c29e87c8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.499729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1de269f0-e543-4f7a-bc03-957d55384ac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb3f105073184b5c8f57a208c29e87c8'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.513937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1086/2168] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:47:57 2022] DELETE /identity/v3/users/bb3f105073184b5c8f57a208c29e87c8 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:58.518658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c987a9-a73d-483a-8e53-2766e64a20cb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:58.519296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c987a9-a73d-483a-8e53-2766e64a20cb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:58.519763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c987a9-a73d-483a-8e53-2766e64a20cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:58.531030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862fdc74-5353-4324-a799-6a7941323361 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:58.541091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f2c987a9-a73d-483a-8e53-2766e64a20cb None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:58.542599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f2c987a9-a73d-483a-8e53-2766e64a20cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:58.603795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:58.604693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:58.604978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:58.605279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] PATH_INFO: `/v3/projects/a797a057ea1d48a2a8532439a9968787` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:58.606626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a797a057ea1d48a2a8532439a9968787)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:58.608668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:58.619672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:58.628124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1087/2169] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:58.639150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c987a9-a73d-483a-8e53-2766e64a20cb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:58.640725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f2c987a9-a73d-483a-8e53-2766e64a20cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:58.709575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c987a9-a73d-483a-8e53-2766e64a20cb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:58.716495 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f828b8-cc19-4c1f-92a8-7d13e20aa896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:58.717498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f828b8-cc19-4c1f-92a8-7d13e20aa896 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:58.718044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f828b8-cc19-4c1f-92a8-7d13e20aa896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:58.718798 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f828b8-cc19-4c1f-92a8-7d13e20aa896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:58.732422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f828b8-cc19-4c1f-92a8-7d13e20aa896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:58.734312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f828b8-cc19-4c1f-92a8-7d13e20aa896 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:58.745570 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1088/2170] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:58.804210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a797a057ea1d48a2a8532439a9968787', 'request_id': 'req-54aa7975-8764-42c5-b51e-e5a10f30038e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.814291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a797a057ea1d48a2a8532439a9968787', 'request_id': 'req-54aa7975-8764-42c5-b51e-e5a10f30038e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.825487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a797a057ea1d48a2a8532439a9968787', 'request_id': 'req-54aa7975-8764-42c5-b51e-e5a10f30038e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.929805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] The token cache is being invalidate because project a797a057ea1d48a2a8532439a9968787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:58.930113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.931678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.933646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1083/2171] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:58 2022] DELETE /identity/v3/projects/a797a057ea1d48a2a8532439a9968787 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:58.981268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:59.044457 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f828b8-cc19-4c1f-92a8-7d13e20aa896 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:59.047495 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-71f828b8-cc19-4c1f-92a8-7d13e20aa896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:59.098200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f828b8-cc19-4c1f-92a8-7d13e20aa896 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:59.177163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:59.178242 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:59.178660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:59.179004 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] PATH_INFO: `/v3/projects/6f371f7d1c42444c9440dfc22ec91fa9` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:59.180925 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f371f7d1c42444c9440dfc22ec91fa9)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:59.184109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:59.368948 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f371f7d1c42444c9440dfc22ec91fa9', 'request_id': 'req-9a54f853-68f7-4222-a6f9-c5128ad6c126'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.374332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f371f7d1c42444c9440dfc22ec91fa9', 'request_id': 'req-9a54f853-68f7-4222-a6f9-c5128ad6c126'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.380497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f371f7d1c42444c9440dfc22ec91fa9', 'request_id': 'req-9a54f853-68f7-4222-a6f9-c5128ad6c126'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.391902 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:59.393502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:59.408936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa7975-8764-42c5-b51e-e5a10f30038e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:59.480136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:59.481003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:59.481287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:59.481566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] PATH_INFO: `/v3/projects/8f62a9832f8e49c1841a209d1198af4d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:59.482789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f62a9832f8e49c1841a209d1198af4d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:59.484702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:59.524156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] The token cache is being invalidate because project 6f371f7d1c42444c9440dfc22ec91fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:59.545838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.545838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-9a54f853-68f7-4222-a6f9-c5128ad6c126 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.545838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1089/2172] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:59 2022] DELETE /identity/v3/projects/6f371f7d1c42444c9440dfc22ec91fa9 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:59.639991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f62a9832f8e49c1841a209d1198af4d', 'request_id': 'req-10070a42-a908-49e5-9a8b-6d0748b804f9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.660442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f62a9832f8e49c1841a209d1198af4d', 'request_id': 'req-10070a42-a908-49e5-9a8b-6d0748b804f9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.668217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f62a9832f8e49c1841a209d1198af4d', 'request_id': 'req-10070a42-a908-49e5-9a8b-6d0748b804f9'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.800670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] The token cache is being invalidate because project 8f62a9832f8e49c1841a209d1198af4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:59.801903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.802354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-10070a42-a908-49e5-9a8b-6d0748b804f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.804980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1084/2173] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:47:59 2022] DELETE /identity/v3/projects/8f62a9832f8e49c1841a209d1198af4d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:59.812129 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d7fda-0c28-4b25-967a-4fa42ea4e7ab None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:59.812462 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d7fda-0c28-4b25-967a-4fa42ea4e7ab None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:59.812867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d7fda-0c28-4b25-967a-4fa42ea4e7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:59.832789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f16d7fda-0c28-4b25-967a-4fa42ea4e7ab None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:59.834084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f16d7fda-0c28-4b25-967a-4fa42ea4e7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:59.899991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1090/2174] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:59.908203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e63dd-e1e7-48b7-b19c-d9013b0a7fc5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:59.908496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e63dd-e1e7-48b7-b19c-d9013b0a7fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:59.908806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65e63dd-e1e7-48b7-b19c-d9013b0a7fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:59.929984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f65e63dd-e1e7-48b7-b19c-d9013b0a7fc5 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:59.931205 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f65e63dd-e1e7-48b7-b19c-d9013b0a7fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:59.940323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1085/2175] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:59.945333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d7fda-0c28-4b25-967a-4fa42ea4e7ab None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:59.955923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d7fda-0c28-4b25-967a-4fa42ea4e7ab None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:59.961446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb421d-5e6c-4d98-b63d-e117f33f9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:59.961956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb421d-5e6c-4d98-b63d-e117f33f9d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:59.962247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb421d-5e6c-4d98-b63d-e117f33f9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:59.962532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb421d-5e6c-4d98-b63d-e117f33f9d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:59.963281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb421d-5e6c-4d98-b63d-e117f33f9d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:59.963595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb421d-5e6c-4d98-b63d-e117f33f9d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:59.965234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb421d-5e6c-4d98-b63d-e117f33f9d89 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:59.982191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1091/2176] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:47:59.987077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:59.987736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e63dd-e1e7-48b7-b19c-d9013b0a7fc5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:00.005891 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65e63dd-e1e7-48b7-b19c-d9013b0a7fc5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:00.012172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483d5b-7349-4cb3-aee4-a30cd35113a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:00.014755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483d5b-7349-4cb3-aee4-a30cd35113a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.014755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483d5b-7349-4cb3-aee4-a30cd35113a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.014755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c483d5b-7349-4cb3-aee4-a30cd35113a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.015565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c483d5b-7349-4cb3-aee4-a30cd35113a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:00.020320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c483d5b-7349-4cb3-aee4-a30cd35113a5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.143205 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1086/2177] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:47:59 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:00.148630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb421d-5e6c-4d98-b63d-e117f33f9d89 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:00.159838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb421d-5e6c-4d98-b63d-e117f33f9d89 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:00.223191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df77ae-5176-4d8f-9eaf-ac94e9e2bc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:00.223907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df77ae-5176-4d8f-9eaf-ac94e9e2bc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.224193 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df77ae-5176-4d8f-9eaf-ac94e9e2bc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.224619 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df77ae-5176-4d8f-9eaf-ac94e9e2bc61 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.226722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df77ae-5176-4d8f-9eaf-ac94e9e2bc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:00.229710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df77ae-5176-4d8f-9eaf-ac94e9e2bc61 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.307579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1092/2178] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:48:00 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:00.312064 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483d5b-7349-4cb3-aee4-a30cd35113a5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:00.322996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c483d5b-7349-4cb3-aee4-a30cd35113a5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:00.328788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178daf5-0158-4c63-967b-a27d18771a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:00.329480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178daf5-0158-4c63-967b-a27d18771a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.329806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178daf5-0158-4c63-967b-a27d18771a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.330085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178daf5-0158-4c63-967b-a27d18771a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.330845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178daf5-0158-4c63-967b-a27d18771a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:00.332454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178daf5-0158-4c63-967b-a27d18771a23 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.345158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1087/2179] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:48:00.349651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df77ae-5176-4d8f-9eaf-ac94e9e2bc61 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:00.360800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df77ae-5176-4d8f-9eaf-ac94e9e2bc61 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:00.365470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a4ed9-de28-4d85-b373-d357f247c148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:00.366223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4ed9-de28-4d85-b373-d357f247c148 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.366546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4ed9-de28-4d85-b373-d357f247c148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.367065 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a4ed9-de28-4d85-b373-d357f247c148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.367946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a4ed9-de28-4d85-b373-d357f247c148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:00.370460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a4ed9-de28-4d85-b373-d357f247c148 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.381094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1093/2180] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:00.385484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178daf5-0158-4c63-967b-a27d18771a23 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:00.405657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178daf5-0158-4c63-967b-a27d18771a23 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:00.410423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d3bf0-bb18-4e2d-92b4-5131c8f39b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:00.411300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d3bf0-bb18-4e2d-92b4-5131c8f39b99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.411584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d3bf0-bb18-4e2d-92b4-5131c8f39b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.411861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d3bf0-bb18-4e2d-92b4-5131c8f39b99 admin admin] PATH_INFO: `/v3/projects/e32bae6682094359af6bcfe5264f074e/users/8c75e1fb0d714deabcd9530ab054fa0b/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.427581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d3bf0-bb18-4e2d-92b4-5131c8f39b99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32bae6682094359af6bcfe5264f074e, user_id=8c75e1fb0d714deabcd9530ab054fa0b, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:00.430371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d3bf0-bb18-4e2d-92b4-5131c8f39b99 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.535414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1088/2181] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:48:00 2022] PUT /identity/v3/projects/e32bae6682094359af6bcfe5264f074e/users/8c75e1fb0d714deabcd9530ab054fa0b/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:00.546359 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665443-da2f-46bf-a7dc-2d8c524b3e03 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.546655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665443-da2f-46bf-a7dc-2d8c524b3e03 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.546941 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25665443-da2f-46bf-a7dc-2d8c524b3e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.574398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-25665443-da2f-46bf-a7dc-2d8c524b3e03 None None] MFA Rules not processed for user `8c75e1fb0d714deabcd9530ab054fa0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:00.575633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-25665443-da2f-46bf-a7dc-2d8c524b3e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:00.642540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1094/2182] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:00.654933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d3bf0-bb18-4e2d-92b4-5131c8f39b99 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:00.656854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e50d3bf0-bb18-4e2d-92b4-5131c8f39b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:00.716892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:00.721227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d3bf0-bb18-4e2d-92b4-5131c8f39b99 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:00.726374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad79d0c-1f77-4065-a060-87ebd40a88c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:00.727137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad79d0c-1f77-4065-a060-87ebd40a88c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.727513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad79d0c-1f77-4065-a060-87ebd40a88c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.727802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad79d0c-1f77-4065-a060-87ebd40a88c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.738199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad79d0c-1f77-4065-a060-87ebd40a88c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:00.739772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad79d0c-1f77-4065-a060-87ebd40a88c5 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.750581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1089/2183] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:01.054563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:01.464951 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:02.312399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:02.498560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:03.150472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:03.237656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:03.478112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:03.512490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:03.722010 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:03.786506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:04.026460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:04.089356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:04.243763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:04.278177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:04.431708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:04.471975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:04.746766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:04.809407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:05.093300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:05.127675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:05.333265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:07.483116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25665443-da2f-46bf-a7dc-2d8c524b3e03 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:07.521417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:07.555137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25665443-da2f-46bf-a7dc-2d8c524b3e03 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:07.559897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:07.560881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:07.561166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:07.561441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] PATH_INFO: `/v3/users/8c75e1fb0d714deabcd9530ab054fa0b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:07.562684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c75e1fb0d714deabcd9530ab054fa0b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:07.564610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:07.771862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c75e1fb0d714deabcd9530ab054fa0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.773026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c75e1fb0d714deabcd9530ab054fa0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.843473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c75e1fb0d714deabcd9530ab054fa0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.844174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c75e1fb0d714deabcd9530ab054fa0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.858407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c75e1fb0d714deabcd9530ab054fa0b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.871633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1095/2184] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:48:07 2022] DELETE /identity/v3/users/8c75e1fb0d714deabcd9530ab054fa0b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:07.876302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7e1c-45ec-40e1-961a-8f1ab465d907 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:07.876824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7e1c-45ec-40e1-961a-8f1ab465d907 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:07.876945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c7e1c-45ec-40e1-961a-8f1ab465d907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:07.894796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ba1c7e1c-45ec-40e1-961a-8f1ab465d907 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:07.896046 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ba1c7e1c-45ec-40e1-961a-8f1ab465d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:07.960320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1090/2185] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:07.970515 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:07.971963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.035050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73651e-0fc4-4eb1-b6ce-4db046c474a5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:08.039382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75abd2-8411-4a54-9421-c0ac37a46fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:08.039382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75abd2-8411-4a54-9421-c0ac37a46fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.040072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75abd2-8411-4a54-9421-c0ac37a46fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.040072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75abd2-8411-4a54-9421-c0ac37a46fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.050215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75abd2-8411-4a54-9421-c0ac37a46fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:08.051689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75abd2-8411-4a54-9421-c0ac37a46fd9 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:08.062932 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1096/2186] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:08.564666 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c7e1c-45ec-40e1-961a-8f1ab465d907 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:08.566363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ba1c7e1c-45ec-40e1-961a-8f1ab465d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.579127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c7e1c-45ec-40e1-961a-8f1ab465d907 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:08.583636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:08.584581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.584867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.585143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] PATH_INFO: `/v3/projects/e32bae6682094359af6bcfe5264f074e` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.586383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32bae6682094359af6bcfe5264f074e)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:08.588286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:08.600578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:08.737913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32bae6682094359af6bcfe5264f074e', 'request_id': 'req-8a85983b-4ea6-47e5-a161-c14496065efc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:08.744162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32bae6682094359af6bcfe5264f074e', 'request_id': 'req-8a85983b-4ea6-47e5-a161-c14496065efc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:08.750459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32bae6682094359af6bcfe5264f074e', 'request_id': 'req-8a85983b-4ea6-47e5-a161-c14496065efc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:08.856459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] The token cache is being invalidate because project e32bae6682094359af6bcfe5264f074e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:08.856785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:08.857448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8a85983b-4ea6-47e5-a161-c14496065efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:08.859049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1091/2187] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:48:08 2022] DELETE /identity/v3/projects/e32bae6682094359af6bcfe5264f074e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:08.863968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167c026-f622-4e13-934f-38c5762dab0a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.864479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167c026-f622-4e13-934f-38c5762dab0a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.864698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167c026-f622-4e13-934f-38c5762dab0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.885258 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5167c026-f622-4e13-934f-38c5762dab0a None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:08.886527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5167c026-f622-4e13-934f-38c5762dab0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.938456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:08.952980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1097/2188] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:08.961996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f77d5-0ae9-44f1-ae6b-6ccd1138e13b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.962511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f77d5-0ae9-44f1-ae6b-6ccd1138e13b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.962619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f77d5-0ae9-44f1-ae6b-6ccd1138e13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.982246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-057f77d5-0ae9-44f1-ae6b-6ccd1138e13b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:08.983482 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-057f77d5-0ae9-44f1-ae6b-6ccd1138e13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.992075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1092/2189] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:08.996335 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167c026-f622-4e13-934f-38c5762dab0a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:09.006482 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167c026-f622-4e13-934f-38c5762dab0a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:09.011145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a18b2-2f7c-4b20-90d7-4fda4a9d3ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:09.011820 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a18b2-2f7c-4b20-90d7-4fda4a9d3ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.012566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a18b2-2f7c-4b20-90d7-4fda4a9d3ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.012566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a18b2-2f7c-4b20-90d7-4fda4a9d3ddc admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.013115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a18b2-2f7c-4b20-90d7-4fda4a9d3ddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:09.013421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a18b2-2f7c-4b20-90d7-4fda4a9d3ddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:09.015084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a18b2-2f7c-4b20-90d7-4fda4a9d3ddc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:09.029770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1098/2190] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:09.034055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f77d5-0ae9-44f1-ae6b-6ccd1138e13b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:09.044266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f77d5-0ae9-44f1-ae6b-6ccd1138e13b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:09.049010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83aff6-2c41-4908-8110-ad89ee35a7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:09.049688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83aff6-2c41-4908-8110-ad89ee35a7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.049994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83aff6-2c41-4908-8110-ad89ee35a7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.050275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83aff6-2c41-4908-8110-ad89ee35a7d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.050965 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83aff6-2c41-4908-8110-ad89ee35a7d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:09.052878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83aff6-2c41-4908-8110-ad89ee35a7d7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:09.161775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1093/2191] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:48:09 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:09.166521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a18b2-2f7c-4b20-90d7-4fda4a9d3ddc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:09.176942 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a18b2-2f7c-4b20-90d7-4fda4a9d3ddc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:09.234759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c23d3-e3f6-4450-8591-eb70cfc05c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:09.235441 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c23d3-e3f6-4450-8591-eb70cfc05c0d admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.235727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c23d3-e3f6-4450-8591-eb70cfc05c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.236073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c23d3-e3f6-4450-8591-eb70cfc05c0d admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.236696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c23d3-e3f6-4450-8591-eb70cfc05c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:09.238682 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c23d3-e3f6-4450-8591-eb70cfc05c0d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:09.322151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1099/2192] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:48:09 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:09.326306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83aff6-2c41-4908-8110-ad89ee35a7d7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:09.340740 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83aff6-2c41-4908-8110-ad89ee35a7d7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:09.342913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062f45e-a4eb-4607-a252-dcbd0191e89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:09.343857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062f45e-a4eb-4607-a252-dcbd0191e89a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.344058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062f45e-a4eb-4607-a252-dcbd0191e89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.344310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062f45e-a4eb-4607-a252-dcbd0191e89a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.345075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062f45e-a4eb-4607-a252-dcbd0191e89a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:09.346674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062f45e-a4eb-4607-a252-dcbd0191e89a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:09.359462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1094/2193] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:09.363750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c23d3-e3f6-4450-8591-eb70cfc05c0d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:09.374404 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c23d3-e3f6-4450-8591-eb70cfc05c0d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:09.379880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68896756-904f-4ec6-8086-48a7ea48fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:09.380553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68896756-904f-4ec6-8086-48a7ea48fe49 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.380841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68896756-904f-4ec6-8086-48a7ea48fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.381113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68896756-904f-4ec6-8086-48a7ea48fe49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.381875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68896756-904f-4ec6-8086-48a7ea48fe49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:09.383499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68896756-904f-4ec6-8086-48a7ea48fe49 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:09.397967 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1100/2194] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:09.401992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062f45e-a4eb-4607-a252-dcbd0191e89a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:09.414656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062f45e-a4eb-4607-a252-dcbd0191e89a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:09.419524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd5ed-5114-4800-ac7d-f643a1eaac40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:09.420423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd5ed-5114-4800-ac7d-f643a1eaac40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.420717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd5ed-5114-4800-ac7d-f643a1eaac40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.421043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd5ed-5114-4800-ac7d-f643a1eaac40 admin admin] PATH_INFO: `/v3/projects/d539dfec943a44eb9b025d842a1f858d/users/646a9abb1f9d4a1295a04defd895ff7c/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.439738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fd5ed-5114-4800-ac7d-f643a1eaac40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d539dfec943a44eb9b025d842a1f858d, user_id=646a9abb1f9d4a1295a04defd895ff7c, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:09.442515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fd5ed-5114-4800-ac7d-f643a1eaac40 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:09.531003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1095/2195] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:48:09 2022] PUT /identity/v3/projects/d539dfec943a44eb9b025d842a1f858d/users/646a9abb1f9d4a1295a04defd895ff7c/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:09.536205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506de98a-415a-4d88-bcb9-265e9a807730 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.536716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506de98a-415a-4d88-bcb9-265e9a807730 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.537002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506de98a-415a-4d88-bcb9-265e9a807730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.556775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-506de98a-415a-4d88-bcb9-265e9a807730 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:09.558067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-506de98a-415a-4d88-bcb9-265e9a807730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:09.622054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1101/2196] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:09.632965 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd5ed-5114-4800-ac7d-f643a1eaac40 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:09.635038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6c9fd5ed-5114-4800-ac7d-f643a1eaac40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:09.694203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd5ed-5114-4800-ac7d-f643a1eaac40 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:09.698391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092111d0-83c2-4654-98f8-732c017451a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:09.701584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092111d0-83c2-4654-98f8-732c017451a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.701584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092111d0-83c2-4654-98f8-732c017451a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.701584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092111d0-83c2-4654-98f8-732c017451a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.709702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092111d0-83c2-4654-98f8-732c017451a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:09.711157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092111d0-83c2-4654-98f8-732c017451a7 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:09.721638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1096/2197] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:11.382537 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ba0ae-5f17-4050-b2ca-53b80898ee2f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.383283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ba0ae-5f17-4050-b2ca-53b80898ee2f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.383644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ba0ae-5f17-4050-b2ca-53b80898ee2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.415325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-877ba0ae-5f17-4050-b2ca-53b80898ee2f None None] MFA Rules not processed for user `646a9abb1f9d4a1295a04defd895ff7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:11.416751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-877ba0ae-5f17-4050-b2ca-53b80898ee2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:11.466584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:11.488098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1102/2198] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:11.499960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092111d0-83c2-4654-98f8-732c017451a7 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:11.505565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-092111d0-83c2-4654-98f8-732c017451a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:11.548794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:11.563844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092111d0-83c2-4654-98f8-732c017451a7 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.568979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4883b1-0c9d-4631-906e-ea18c6ddee5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.568979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4883b1-0c9d-4631-906e-ea18c6ddee5e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.568979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4883b1-0c9d-4631-906e-ea18c6ddee5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.568979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4883b1-0c9d-4631-906e-ea18c6ddee5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.578122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4883b1-0c9d-4631-906e-ea18c6ddee5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.579601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4883b1-0c9d-4631-906e-ea18c6ddee5e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.589766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1097/2199] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:13.715766 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e94a6-208d-4201-b7f5-231e47d5e6f3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.716292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e94a6-208d-4201-b7f5-231e47d5e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.716483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e94a6-208d-4201-b7f5-231e47d5e6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.735316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f63e94a6-208d-4201-b7f5-231e47d5e6f3 None None] MFA Rules not processed for user `646a9abb1f9d4a1295a04defd895ff7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:13.736077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f63e94a6-208d-4201-b7f5-231e47d5e6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:13.744071 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1103/2200] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:23.254590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=9 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:23.404117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71e22-4b61-4897-ae02-c22c380f1147 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.404590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71e22-4b61-4897-ae02-c22c380f1147 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.406223 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71e22-4b61-4897-ae02-c22c380f1147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.423897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2ab71e22-4b61-4897-ae02-c22c380f1147 None None] MFA Rules not processed for user `0537911b91184fcdbdcc9e93ec3fe5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:23.425100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2ab71e22-4b61-4897-ae02-c22c380f1147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:23.484995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1098/2201] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:23.622487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d259-5f4e-4ce7-8b40-5a8a738dff28 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.622984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d259-5f4e-4ce7-8b40-5a8a738dff28 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.623088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896d259-5f4e-4ce7-8b40-5a8a738dff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.641082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6896d259-5f4e-4ce7-8b40-5a8a738dff28 None None] MFA Rules not processed for user `cf98a4d33cab49b08640f437dbfb2dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:23.642332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6896d259-5f4e-4ce7-8b40-5a8a738dff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:23.700214 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1104/2202] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:24.242125 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10029-d443-4d5e-95bc-81c11db9ce8e None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.242444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10029-d443-4d5e-95bc-81c11db9ce8e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.242917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a10029-d443-4d5e-95bc-81c11db9ce8e None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.244300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1099/2203] 10.222.0.41 () {54 vars in 912 bytes} [Thu May 26 12:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:48:24.249542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce083-7142-4f38-804c-607b58af2cb8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.249888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce083-7142-4f38-804c-607b58af2cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.250169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fce083-7142-4f38-804c-607b58af2cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.279396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-52fce083-7142-4f38-804c-607b58af2cb8 None None] MFA Rules not processed for user `d7a0dbcea7ef4cdd9134f4c5a9cf5fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:24.280606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-52fce083-7142-4f38-804c-607b58af2cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:24.288862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1105/2204] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:24.301337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10029-d443-4d5e-95bc-81c11db9ce8e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:24.312513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a10029-d443-4d5e-95bc-81c11db9ce8e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:24.317848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5686eb5-2302-4d50-a6d7-7dc1b4a2db89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:24.317848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5686eb5-2302-4d50-a6d7-7dc1b4a2db89 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.317848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5686eb5-2302-4d50-a6d7-7dc1b4a2db89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.318309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5686eb5-2302-4d50-a6d7-7dc1b4a2db89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.326835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5686eb5-2302-4d50-a6d7-7dc1b4a2db89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:24.328365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5686eb5-2302-4d50-a6d7-7dc1b4a2db89 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:24.338572 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1100/2205] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:28.011052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bfd6-95b9-479d-8a19-2e97477fa521 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:28.012249 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bfd6-95b9-479d-8a19-2e97477fa521 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:28.012689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696bfd6-95b9-479d-8a19-2e97477fa521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:28.111518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7696bfd6-95b9-479d-8a19-2e97477fa521 None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:28.114991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7696bfd6-95b9-479d-8a19-2e97477fa521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:28.237691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1106/2206] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:48:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:28.295733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5686eb5-2302-4d50-a6d7-7dc1b4a2db89 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:28.298148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f5686eb5-2302-4d50-a6d7-7dc1b4a2db89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:28.433353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5686eb5-2302-4d50-a6d7-7dc1b4a2db89 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:28.440116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab684e-bf4b-48e7-89e9-f7fde35ee818 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:28.441063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab684e-bf4b-48e7-89e9-f7fde35ee818 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:28.441497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab684e-bf4b-48e7-89e9-f7fde35ee818 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:28.442030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab684e-bf4b-48e7-89e9-f7fde35ee818 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:28.460809 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab684e-bf4b-48e7-89e9-f7fde35ee818 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:28.463214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab684e-bf4b-48e7-89e9-f7fde35ee818 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:28.473960 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1101/2207] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:48:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:48:29.112961 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696bfd6-95b9-479d-8a19-2e97477fa521 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:29.117934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7696bfd6-95b9-479d-8a19-2e97477fa521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:29.154861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696bfd6-95b9-479d-8a19-2e97477fa521 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:29.168720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:29.168720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.168720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.168720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] PATH_INFO: `/v3/users/ad0a74d5c49643e49e4e21398ebaebef` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.173638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0a74d5c49643e49e4e21398ebaebef)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:29.175694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:29.529145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:29.549828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0a74d5c49643e49e4e21398ebaebef'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.551175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0a74d5c49643e49e4e21398ebaebef'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.688046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0a74d5c49643e49e4e21398ebaebef'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.688979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0a74d5c49643e49e4e21398ebaebef'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.717391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0a74d5c49643e49e4e21398ebaebef'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.744945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1107/2208] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:48:29 2022] DELETE /identity/v3/users/ad0a74d5c49643e49e4e21398ebaebef => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:29.746684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73faf19-f5cd-4172-8cb2-ca7ba87d83f2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.747149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73faf19-f5cd-4172-8cb2-ca7ba87d83f2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.747444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73faf19-f5cd-4172-8cb2-ca7ba87d83f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.772436 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f73faf19-f5cd-4172-8cb2-ca7ba87d83f2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:29.774392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f73faf19-f5cd-4172-8cb2-ca7ba87d83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:29.862887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1102/2209] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:29.933736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:29.935897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:30.032582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eedbdde-1702-4287-9256-3a0741d0fcb2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.037495 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402c4d6-d562-4d1d-9de5-32eeabb91d3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.037703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c4d6-d562-4d1d-9de5-32eeabb91d3c service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.037982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c4d6-d562-4d1d-9de5-32eeabb91d3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.038268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402c4d6-d562-4d1d-9de5-32eeabb91d3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.048928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402c4d6-d562-4d1d-9de5-32eeabb91d3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.053895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402c4d6-d562-4d1d-9de5-32eeabb91d3c service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:30.062363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1108/2210] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:31.399895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73faf19-f5cd-4172-8cb2-ca7ba87d83f2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:31.401495 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f73faf19-f5cd-4172-8cb2-ca7ba87d83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:31.408570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:31.422203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73faf19-f5cd-4172-8cb2-ca7ba87d83f2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:31.437341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:31.438389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.438883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.439393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] PATH_INFO: `/v3/projects/4e4b7aab50fd468baef55246c935680b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.447035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4b7aab50fd468baef55246c935680b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:31.449561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:31.644884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4b7aab50fd468baef55246c935680b', 'request_id': 'req-8390a922-fa89-459b-a1c9-640df95bd98f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:31.654038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4b7aab50fd468baef55246c935680b', 'request_id': 'req-8390a922-fa89-459b-a1c9-640df95bd98f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:31.665904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4b7aab50fd468baef55246c935680b', 'request_id': 'req-8390a922-fa89-459b-a1c9-640df95bd98f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:31.749614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] The token cache is being invalidate because project 4e4b7aab50fd468baef55246c935680b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:31.749614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:31.749614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:31.749887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1103/2211] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:48:31 2022] DELETE /identity/v3/projects/4e4b7aab50fd468baef55246c935680b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:31.753835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402c4d6-d562-4d1d-9de5-32eeabb91d3c service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:31.768590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402c4d6-d562-4d1d-9de5-32eeabb91d3c service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:31.849112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:31.850669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.850964 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.851250 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] PATH_INFO: `/v3/users/5baf45b81567429f914782091471f7d1` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.852636 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5baf45b81567429f914782091471f7d1)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:31.856883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:32.129805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5baf45b81567429f914782091471f7d1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:32.129805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5baf45b81567429f914782091471f7d1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:32.129805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:32.871399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5baf45b81567429f914782091471f7d1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:32.872114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5baf45b81567429f914782091471f7d1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:32.885391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ecd6754-42f7-4c09-ac38-25c1c4e05e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5baf45b81567429f914782091471f7d1'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:32.900393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1109/2212] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:48:31 2022] DELETE /identity/v3/users/5baf45b81567429f914782091471f7d1 => generated 0 bytes in 1147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:33.543099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:33.545916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:33.592150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390a922-fa89-459b-a1c9-640df95bd98f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:33.688397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:33.689630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:33.689797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:33.690032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] PATH_INFO: `/v3/projects/0752524a9d97496bbc21a11bfafc73bd` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:33.691287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0752524a9d97496bbc21a11bfafc73bd)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:33.693272 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:33.851027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0752524a9d97496bbc21a11bfafc73bd', 'request_id': 'req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:33.861170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0752524a9d97496bbc21a11bfafc73bd', 'request_id': 'req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:33.888131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0752524a9d97496bbc21a11bfafc73bd', 'request_id': 'req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:34.027489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] The token cache is being invalidate because project 0752524a9d97496bbc21a11bfafc73bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:34.027489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:34.027489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5b7b3cb5-77ce-4aad-bb53-e36d46817de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:34.027489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1104/2213] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:48:33 2022] DELETE /identity/v3/projects/0752524a9d97496bbc21a11bfafc73bd => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:34.030687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0052d09-98be-46da-bf15-94ac949bf79e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:34.031714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0052d09-98be-46da-bf15-94ac949bf79e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:34.032215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0052d09-98be-46da-bf15-94ac949bf79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:34.065127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b0052d09-98be-46da-bf15-94ac949bf79e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:34.066742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b0052d09-98be-46da-bf15-94ac949bf79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:34.167206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1110/2214] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:34.168952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9967-1929-4957-ab14-9ab1e06d1bb7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:34.169351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9967-1929-4957-ab14-9ab1e06d1bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:34.169773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f9967-1929-4957-ab14-9ab1e06d1bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:34.192456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-103f9967-1929-4957-ab14-9ab1e06d1bb7 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:34.194040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-103f9967-1929-4957-ab14-9ab1e06d1bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:34.212017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1105/2215] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:34.217600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0052d09-98be-46da-bf15-94ac949bf79e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:34.236006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0052d09-98be-46da-bf15-94ac949bf79e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:34.242214 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250552d0-9328-4f3c-8801-1a1b8260dc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:34.243240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250552d0-9328-4f3c-8801-1a1b8260dc15 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:34.243696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250552d0-9328-4f3c-8801-1a1b8260dc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:34.244144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250552d0-9328-4f3c-8801-1a1b8260dc15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:34.245043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250552d0-9328-4f3c-8801-1a1b8260dc15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:34.245505 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250552d0-9328-4f3c-8801-1a1b8260dc15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:34.247352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250552d0-9328-4f3c-8801-1a1b8260dc15 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:34.278077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1111/2216] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:48:34.279285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9967-1929-4957-ab14-9ab1e06d1bb7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:34.296635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f9967-1929-4957-ab14-9ab1e06d1bb7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:34.313173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660f2f4-7668-4dac-bbe6-16840c44bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:34.314073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660f2f4-7668-4dac-bbe6-16840c44bdb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:34.314863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660f2f4-7668-4dac-bbe6-16840c44bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:34.315394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660f2f4-7668-4dac-bbe6-16840c44bdb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:34.316099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660f2f4-7668-4dac-bbe6-16840c44bdb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:34.318062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660f2f4-7668-4dac-bbe6-16840c44bdb3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:34.324945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:34.444932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1106/2217] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:48:34 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:34.449150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250552d0-9328-4f3c-8801-1a1b8260dc15 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:34.475811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250552d0-9328-4f3c-8801-1a1b8260dc15 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:34.602913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2816d3b-c83b-4c66-a336-995f130d3020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:34.604044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2816d3b-c83b-4c66-a336-995f130d3020 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:34.604541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2816d3b-c83b-4c66-a336-995f130d3020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:34.605028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2816d3b-c83b-4c66-a336-995f130d3020 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:34.606255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2816d3b-c83b-4c66-a336-995f130d3020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:34.608901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2816d3b-c83b-4c66-a336-995f130d3020 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:34.753790 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1112/2218] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:48:34 2022] POST /identity/v3/users => generated 294 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:34.754608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660f2f4-7668-4dac-bbe6-16840c44bdb3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:34.778274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660f2f4-7668-4dac-bbe6-16840c44bdb3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:34.788269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6305620-091f-4cdd-bbe0-cb651eb0d4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:34.788958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6305620-091f-4cdd-bbe0-cb651eb0d4cc admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:34.789988 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6305620-091f-4cdd-bbe0-cb651eb0d4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:34.795433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6305620-091f-4cdd-bbe0-cb651eb0d4cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:34.795433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6305620-091f-4cdd-bbe0-cb651eb0d4cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:34.795433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6305620-091f-4cdd-bbe0-cb651eb0d4cc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:34.832285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1107/2219] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:34.835479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2816d3b-c83b-4c66-a336-995f130d3020 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:34.862681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2816d3b-c83b-4c66-a336-995f130d3020 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:34.874029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb27d9-f87d-46f6-b2e2-ee5e9b438a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:34.875031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb27d9-f87d-46f6-b2e2-ee5e9b438a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:34.875319 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb27d9-f87d-46f6-b2e2-ee5e9b438a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:34.875604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb27d9-f87d-46f6-b2e2-ee5e9b438a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:34.876352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb27d9-f87d-46f6-b2e2-ee5e9b438a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:34.879370 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb27d9-f87d-46f6-b2e2-ee5e9b438a87 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:34.891811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1113/2220] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:34.895949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6305620-091f-4cdd-bbe0-cb651eb0d4cc admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:34.915820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6305620-091f-4cdd-bbe0-cb651eb0d4cc admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:34.930972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03d383-3796-4fda-b22c-6b750665208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:34.932716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03d383-3796-4fda-b22c-6b750665208c admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:34.933012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03d383-3796-4fda-b22c-6b750665208c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:34.933334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df03d383-3796-4fda-b22c-6b750665208c admin admin] PATH_INFO: `/v3/projects/f96c286913c547a980e93b4317ebeed8/users/276626f2e74c4270b1f1a13fd8eeaa7b/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:34.982938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03d383-3796-4fda-b22c-6b750665208c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96c286913c547a980e93b4317ebeed8, user_id=276626f2e74c4270b1f1a13fd8eeaa7b, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:34.985856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df03d383-3796-4fda-b22c-6b750665208c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:35.098287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1108/2221] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:48:34 2022] PUT /identity/v3/projects/f96c286913c547a980e93b4317ebeed8/users/276626f2e74c4270b1f1a13fd8eeaa7b/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:35.108013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ebb27-d082-4746-9ee4-6fa174de48df None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:35.108576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ebb27-d082-4746-9ee4-6fa174de48df None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:35.108576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ebb27-d082-4746-9ee4-6fa174de48df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:35.137945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d49ebb27-d082-4746-9ee4-6fa174de48df None None] MFA Rules not processed for user `276626f2e74c4270b1f1a13fd8eeaa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:35.139635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d49ebb27-d082-4746-9ee4-6fa174de48df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:35.171739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:35.232201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1114/2222] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:35.236119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03d383-3796-4fda-b22c-6b750665208c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:35.341729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df03d383-3796-4fda-b22c-6b750665208c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:35.352364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43c561-4613-4863-bbdd-ae240fb27bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:35.353102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43c561-4613-4863-bbdd-ae240fb27bad admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:35.353538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43c561-4613-4863-bbdd-ae240fb27bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:35.353881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43c561-4613-4863-bbdd-ae240fb27bad admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:35.354597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43c561-4613-4863-bbdd-ae240fb27bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:35.356623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43c561-4613-4863-bbdd-ae240fb27bad admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:35.463584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1109/2223] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:48:35 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:35.464794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ebb27-d082-4746-9ee4-6fa174de48df None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:35.494623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ebb27-d082-4746-9ee4-6fa174de48df None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:35.566167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452ea8d-65f0-49f7-bff3-b1379b93f181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:35.567297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452ea8d-65f0-49f7-bff3-b1379b93f181 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:35.567800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452ea8d-65f0-49f7-bff3-b1379b93f181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:35.568298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0452ea8d-65f0-49f7-bff3-b1379b93f181 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:35.569265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452ea8d-65f0-49f7-bff3-b1379b93f181 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:35.571359 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0452ea8d-65f0-49f7-bff3-b1379b93f181 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:35.688600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1115/2224] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:48:35 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:35.689310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43c561-4613-4863-bbdd-ae240fb27bad admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:35.705460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43c561-4613-4863-bbdd-ae240fb27bad admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:35.712322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d1a25-dad9-4511-8917-f1d33c9e294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:35.713110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d1a25-dad9-4511-8917-f1d33c9e294d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:35.713501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d1a25-dad9-4511-8917-f1d33c9e294d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:35.714013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d1a25-dad9-4511-8917-f1d33c9e294d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:35.715108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d1a25-dad9-4511-8917-f1d33c9e294d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:35.717373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d1a25-dad9-4511-8917-f1d33c9e294d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:35.734871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1110/2225] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:35.736520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452ea8d-65f0-49f7-bff3-b1379b93f181 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:35.750626 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0452ea8d-65f0-49f7-bff3-b1379b93f181 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:35.766898 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d9e9b-dab7-4b3b-bb3c-724dbac51613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:35.766898 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d9e9b-dab7-4b3b-bb3c-724dbac51613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:35.767309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d9e9b-dab7-4b3b-bb3c-724dbac51613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:35.767652 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d9e9b-dab7-4b3b-bb3c-724dbac51613 admin admin] PATH_INFO: `/v3/projects/97a12cfa1b2741f6af4dfd8dd866d145/users/da72d48f89e84ecd845e2227bd8ab461/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:35.800025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d9e9b-dab7-4b3b-bb3c-724dbac51613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a12cfa1b2741f6af4dfd8dd866d145, user_id=da72d48f89e84ecd845e2227bd8ab461, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:35.804092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d9e9b-dab7-4b3b-bb3c-724dbac51613 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:35.887994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1116/2226] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:48:35 2022] PUT /identity/v3/projects/97a12cfa1b2741f6af4dfd8dd866d145/users/da72d48f89e84ecd845e2227bd8ab461/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:35.888378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d1a25-dad9-4511-8917-f1d33c9e294d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:35.899886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d1a25-dad9-4511-8917-f1d33c9e294d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:35.997171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686e982-5ccc-4bcf-8313-49f68ae3f951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:35.997978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e982-5ccc-4bcf-8313-49f68ae3f951 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:35.998568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e982-5ccc-4bcf-8313-49f68ae3f951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:35.998869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686e982-5ccc-4bcf-8313-49f68ae3f951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:35.999633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686e982-5ccc-4bcf-8313-49f68ae3f951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:36.001352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686e982-5ccc-4bcf-8313-49f68ae3f951 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:36.017053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1111/2227] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:36.024294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d9e9b-dab7-4b3b-bb3c-724dbac51613 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:36.043794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d9e9b-dab7-4b3b-bb3c-724dbac51613 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:36.049580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b3792-9994-4ebf-8ae7-d178f787ca38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:36.050586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b3792-9994-4ebf-8ae7-d178f787ca38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:36.050952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b3792-9994-4ebf-8ae7-d178f787ca38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:36.051300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b3792-9994-4ebf-8ae7-d178f787ca38 admin admin] PATH_INFO: `/v3/projects/97a12cfa1b2741f6af4dfd8dd866d145/users/da72d48f89e84ecd845e2227bd8ab461/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:36.054265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b3792-9994-4ebf-8ae7-d178f787ca38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a12cfa1b2741f6af4dfd8dd866d145, user_id=da72d48f89e84ecd845e2227bd8ab461, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:36.057437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b3792-9994-4ebf-8ae7-d178f787ca38 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:36.093116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1117/2228] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:48:36 2022] PUT /identity/v3/projects/97a12cfa1b2741f6af4dfd8dd866d145/users/da72d48f89e84ecd845e2227bd8ab461/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:36.103967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c5e4-9969-4a73-8c84-10295838160e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:36.104369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c5e4-9969-4a73-8c84-10295838160e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:36.104673 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347c5e4-9969-4a73-8c84-10295838160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:36.146601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3347c5e4-9969-4a73-8c84-10295838160e None None] MFA Rules not processed for user `da72d48f89e84ecd845e2227bd8ab461`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:36.148072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3347c5e4-9969-4a73-8c84-10295838160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:36.162283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:36.271002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1112/2229] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:36.284049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b3792-9994-4ebf-8ae7-d178f787ca38 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:36.285964 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cc7b3792-9994-4ebf-8ae7-d178f787ca38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:36.416418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b3792-9994-4ebf-8ae7-d178f787ca38 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:36.424073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57514e-e136-4091-9e68-f948c01a1690 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:36.425010 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57514e-e136-4091-9e68-f948c01a1690 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:36.425440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57514e-e136-4091-9e68-f948c01a1690 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:36.425885 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57514e-e136-4091-9e68-f948c01a1690 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:36.457117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57514e-e136-4091-9e68-f948c01a1690 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:36.462699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57514e-e136-4091-9e68-f948c01a1690 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:36.490039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1118/2230] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:36.601434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c5e4-9969-4a73-8c84-10295838160e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:36.695132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347c5e4-9969-4a73-8c84-10295838160e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:36.707240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:36.708241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:36.708553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:36.708859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] PATH_INFO: `/v3/users/276626f2e74c4270b1f1a13fd8eeaa7b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:36.710141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=276626f2e74c4270b1f1a13fd8eeaa7b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:36.712297 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:37.241094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '276626f2e74c4270b1f1a13fd8eeaa7b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:37.468288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '276626f2e74c4270b1f1a13fd8eeaa7b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:37.468983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '276626f2e74c4270b1f1a13fd8eeaa7b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:37.469688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '276626f2e74c4270b1f1a13fd8eeaa7b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:37.491617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '276626f2e74c4270b1f1a13fd8eeaa7b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:37.508905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1113/2231] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:48:36 2022] DELETE /identity/v3/users/276626f2e74c4270b1f1a13fd8eeaa7b => generated 0 bytes in 910 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:37.513735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ec2b4-7fb9-4763-8446-8a91878f7e54 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:37.520955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ec2b4-7fb9-4763-8446-8a91878f7e54 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:37.520955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ec2b4-7fb9-4763-8446-8a91878f7e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:37.540866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-473ec2b4-7fb9-4763-8446-8a91878f7e54 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:37.542138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-473ec2b4-7fb9-4763-8446-8a91878f7e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:37.621323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1119/2232] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:37.630687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:37.632362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:37.714674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17001cb3-9315-4870-b4b4-bd308ffa3d84 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:37.738465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d2008-c509-47ca-9bbd-dd45fe1f5e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:37.739150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d2008-c509-47ca-9bbd-dd45fe1f5e02 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:37.739444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d2008-c509-47ca-9bbd-dd45fe1f5e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:37.739732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d2008-c509-47ca-9bbd-dd45fe1f5e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:37.780282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d2008-c509-47ca-9bbd-dd45fe1f5e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:37.782866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d2008-c509-47ca-9bbd-dd45fe1f5e02 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:37.803458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1114/2233] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:37.911572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:38.143586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:38.644511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ec2b4-7fb9-4763-8446-8a91878f7e54 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:38.646922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-473ec2b4-7fb9-4763-8446-8a91878f7e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:38.667257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ec2b4-7fb9-4763-8446-8a91878f7e54 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:38.678497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:38.680512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:38.681029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:38.681982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] PATH_INFO: `/v3/projects/f96c286913c547a980e93b4317ebeed8` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:38.684713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96c286913c547a980e93b4317ebeed8)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:38.687842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:38.878149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96c286913c547a980e93b4317ebeed8', 'request_id': 'req-75560012-da82-45fd-a6ad-d4dde658d8b5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.884591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96c286913c547a980e93b4317ebeed8', 'request_id': 'req-75560012-da82-45fd-a6ad-d4dde658d8b5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.899966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96c286913c547a980e93b4317ebeed8', 'request_id': 'req-75560012-da82-45fd-a6ad-d4dde658d8b5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.010606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] The token cache is being invalidate because project f96c286913c547a980e93b4317ebeed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:39.010914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.011716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.015412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1120/2234] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:48:38 2022] DELETE /identity/v3/projects/f96c286913c547a980e93b4317ebeed8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:39.019949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d2008-c509-47ca-9bbd-dd45fe1f5e02 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:39.031352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d2008-c509-47ca-9bbd-dd45fe1f5e02 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:39.157489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:39.160557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:39.161188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:39.166749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] PATH_INFO: `/v3/users/da72d48f89e84ecd845e2227bd8ab461` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:39.166848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=da72d48f89e84ecd845e2227bd8ab461)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:39.174411 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:39.454133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da72d48f89e84ecd845e2227bd8ab461'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.595058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da72d48f89e84ecd845e2227bd8ab461'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.606263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da72d48f89e84ecd845e2227bd8ab461'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.606263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da72d48f89e84ecd845e2227bd8ab461'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.611086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-29dfe3ba-01a9-4e6a-b99e-6704e21e5a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da72d48f89e84ecd845e2227bd8ab461'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.654955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1115/2235] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:48:39 2022] DELETE /identity/v3/users/da72d48f89e84ecd845e2227bd8ab461 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:40.713967 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:40.715681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:40.729502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75560012-da82-45fd-a6ad-d4dde658d8b5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:40.793226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:40.794143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:40.794431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:40.796794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] PATH_INFO: `/v3/projects/97a12cfa1b2741f6af4dfd8dd866d145` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:40.796794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a12cfa1b2741f6af4dfd8dd866d145)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:40.797824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:40.936769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:40.940834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a12cfa1b2741f6af4dfd8dd866d145', 'request_id': 'req-a4ac6385-e30b-47f1-b976-c512115de510'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.948681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a12cfa1b2741f6af4dfd8dd866d145', 'request_id': 'req-a4ac6385-e30b-47f1-b976-c512115de510'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.956241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a12cfa1b2741f6af4dfd8dd866d145', 'request_id': 'req-a4ac6385-e30b-47f1-b976-c512115de510'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.132348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] The token cache is being invalidate because project 97a12cfa1b2741f6af4dfd8dd866d145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:41.132813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.134316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a4ac6385-e30b-47f1-b976-c512115de510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.137736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1121/2236] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:48:40 2022] DELETE /identity/v3/projects/97a12cfa1b2741f6af4dfd8dd866d145 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:41.143230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcc834-2c4f-4958-8867-c5b5ea7268fa None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.144256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcc834-2c4f-4958-8867-c5b5ea7268fa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.144554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bcc834-2c4f-4958-8867-c5b5ea7268fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.170957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-92bcc834-2c4f-4958-8867-c5b5ea7268fa None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:41.172291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-92bcc834-2c4f-4958-8867-c5b5ea7268fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.234668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:41.251474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1116/2237] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:41.260890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f2db-04bf-4fc5-9338-1062c45c5876 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.261272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f2db-04bf-4fc5-9338-1062c45c5876 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.261630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea23f2db-04bf-4fc5-9338-1062c45c5876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.299217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ea23f2db-04bf-4fc5-9338-1062c45c5876 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:41.300725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ea23f2db-04bf-4fc5-9338-1062c45c5876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.312904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1122/2238] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:41.315136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcc834-2c4f-4958-8867-c5b5ea7268fa None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.332905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bcc834-2c4f-4958-8867-c5b5ea7268fa None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.337292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e000-93bb-4c03-ac70-788b3fae3c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.338106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e000-93bb-4c03-ac70-788b3fae3c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.338501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e000-93bb-4c03-ac70-788b3fae3c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.338852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311e000-93bb-4c03-ac70-788b3fae3c01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.339771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311e000-93bb-4c03-ac70-788b3fae3c01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:41.340151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311e000-93bb-4c03-ac70-788b3fae3c01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.342009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311e000-93bb-4c03-ac70-788b3fae3c01 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.369488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1117/2239] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:41.374552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23f2db-04bf-4fc5-9338-1062c45c5876 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.387864 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea23f2db-04bf-4fc5-9338-1062c45c5876 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.393619 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02845153-ab2a-41c5-85fd-755ad38a51ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.395959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02845153-ab2a-41c5-85fd-755ad38a51ff admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.395959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02845153-ab2a-41c5-85fd-755ad38a51ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.395959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02845153-ab2a-41c5-85fd-755ad38a51ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.397713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02845153-ab2a-41c5-85fd-755ad38a51ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.400845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02845153-ab2a-41c5-85fd-755ad38a51ff admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.532081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1123/2240] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:48:41 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:41.538703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e000-93bb-4c03-ac70-788b3fae3c01 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.569077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311e000-93bb-4c03-ac70-788b3fae3c01 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.642569 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfceed-1c12-49ad-a1c7-16eb36f47e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.643439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfceed-1c12-49ad-a1c7-16eb36f47e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.643872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfceed-1c12-49ad-a1c7-16eb36f47e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.653019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfceed-1c12-49ad-a1c7-16eb36f47e30 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.653019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfceed-1c12-49ad-a1c7-16eb36f47e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.653019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfceed-1c12-49ad-a1c7-16eb36f47e30 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.885612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1118/2241] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:48:41 2022] POST /identity/v3/users => generated 286 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:41.889499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02845153-ab2a-41c5-85fd-755ad38a51ff admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.903156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02845153-ab2a-41c5-85fd-755ad38a51ff admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.909345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bc7a5-9d72-4cc9-8d72-115caf1d0046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.911525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc7a5-9d72-4cc9-8d72-115caf1d0046 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.911814 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc7a5-9d72-4cc9-8d72-115caf1d0046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.912250 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66bc7a5-9d72-4cc9-8d72-115caf1d0046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.913009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bc7a5-9d72-4cc9-8d72-115caf1d0046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.914684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66bc7a5-9d72-4cc9-8d72-115caf1d0046 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.925996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1124/2242] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:41.930104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfceed-1c12-49ad-a1c7-16eb36f47e30 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.940505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfceed-1c12-49ad-a1c7-16eb36f47e30 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.945776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c176b1-c548-4874-aca8-aed87069dd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.946473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c176b1-c548-4874-aca8-aed87069dd47 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.946758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c176b1-c548-4874-aca8-aed87069dd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.947033 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c176b1-c548-4874-aca8-aed87069dd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.947754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c176b1-c548-4874-aca8-aed87069dd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.949376 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c176b1-c548-4874-aca8-aed87069dd47 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.963832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1119/2243] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:48:41.965245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bc7a5-9d72-4cc9-8d72-115caf1d0046 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.976350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66bc7a5-9d72-4cc9-8d72-115caf1d0046 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.981278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5489d-985d-4393-b4c8-c860e93a7329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.982192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5489d-985d-4393-b4c8-c860e93a7329 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.982665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5489d-985d-4393-b4c8-c860e93a7329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.983112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5489d-985d-4393-b4c8-c860e93a7329 admin admin] PATH_INFO: `/v3/projects/0b00a1ff347942be83188a64f75fd04b/users/1aaba5c0d96d48f386049565a5cd3f4d/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.000443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5489d-985d-4393-b4c8-c860e93a7329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b00a1ff347942be83188a64f75fd04b, user_id=1aaba5c0d96d48f386049565a5cd3f4d, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.003159 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5489d-985d-4393-b4c8-c860e93a7329 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.167436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1125/2244] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:48:41 2022] PUT /identity/v3/projects/0b00a1ff347942be83188a64f75fd04b/users/1aaba5c0d96d48f386049565a5cd3f4d/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:42.174434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9df96-2870-42d4-8d86-be664f835777 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.174434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9df96-2870-42d4-8d86-be664f835777 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.174434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9df96-2870-42d4-8d86-be664f835777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.199762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-8bf9df96-2870-42d4-8d86-be664f835777 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:42.205328 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8bf9df96-2870-42d4-8d86-be664f835777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:42.296012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1120/2245] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:42.311823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5489d-985d-4393-b4c8-c860e93a7329 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.313701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-62a5489d-985d-4393-b4c8-c860e93a7329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:42.380340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5489d-985d-4393-b4c8-c860e93a7329 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:42.384749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92024ff7-a0dd-4b78-8812-562390f7255c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:42.388527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92024ff7-a0dd-4b78-8812-562390f7255c service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.388527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92024ff7-a0dd-4b78-8812-562390f7255c service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.388527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92024ff7-a0dd-4b78-8812-562390f7255c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.395755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92024ff7-a0dd-4b78-8812-562390f7255c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.397224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92024ff7-a0dd-4b78-8812-562390f7255c service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.406765 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1126/2246] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:44.946489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9062bcb-476e-43a6-b66c-41167017ceed None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.947027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9062bcb-476e-43a6-b66c-41167017ceed None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.947122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9062bcb-476e-43a6-b66c-41167017ceed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.975462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d9062bcb-476e-43a6-b66c-41167017ceed None None] MFA Rules not processed for user `1aaba5c0d96d48f386049565a5cd3f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:44.976689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d9062bcb-476e-43a6-b66c-41167017ceed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:45.022434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:45.043224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1121/2247] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:45.047824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92024ff7-a0dd-4b78-8812-562390f7255c service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.058191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92024ff7-a0dd-4b78-8812-562390f7255c service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.062723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181d7b-bb24-4b64-9775-15cb8fad4dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.063421 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181d7b-bb24-4b64-9775-15cb8fad4dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.063668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181d7b-bb24-4b64-9775-15cb8fad4dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.063990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc181d7b-bb24-4b64-9775-15cb8fad4dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.064677 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc181d7b-bb24-4b64-9775-15cb8fad4dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.067374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc181d7b-bb24-4b64-9775-15cb8fad4dcb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.220480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1127/2248] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:48:45 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:45.225447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9062bcb-476e-43a6-b66c-41167017ceed None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.236379 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9062bcb-476e-43a6-b66c-41167017ceed None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.296096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8c532-01a1-47a8-8275-eaeb8524bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.296901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8c532-01a1-47a8-8275-eaeb8524bd76 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.297199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8c532-01a1-47a8-8275-eaeb8524bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.297485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8c532-01a1-47a8-8275-eaeb8524bd76 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.301369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8c532-01a1-47a8-8275-eaeb8524bd76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.303370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8c532-01a1-47a8-8275-eaeb8524bd76 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.403657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1122/2249] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:48:45 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:45.409033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181d7b-bb24-4b64-9775-15cb8fad4dcb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.437153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc181d7b-bb24-4b64-9775-15cb8fad4dcb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.442266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952a04b-bfb7-4135-93ef-5d328dfdae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.444737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952a04b-bfb7-4135-93ef-5d328dfdae50 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.444737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952a04b-bfb7-4135-93ef-5d328dfdae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.444737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952a04b-bfb7-4135-93ef-5d328dfdae50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.445042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952a04b-bfb7-4135-93ef-5d328dfdae50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.446691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952a04b-bfb7-4135-93ef-5d328dfdae50 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.459578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1128/2250] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:45.463632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8c532-01a1-47a8-8275-eaeb8524bd76 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.473734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8c532-01a1-47a8-8275-eaeb8524bd76 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.478803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d99bdc-c19b-448b-96b7-d286e5b7c9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.479690 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99bdc-c19b-448b-96b7-d286e5b7c9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.479970 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99bdc-c19b-448b-96b7-d286e5b7c9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.480255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99bdc-c19b-448b-96b7-d286e5b7c9f6 admin admin] PATH_INFO: `/v3/projects/ff611ae22b84465296d95284293eb467/users/9c44214548d3496891b8cf3e8a33f504/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.496949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d99bdc-c19b-448b-96b7-d286e5b7c9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff611ae22b84465296d95284293eb467, user_id=9c44214548d3496891b8cf3e8a33f504, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.499692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d99bdc-c19b-448b-96b7-d286e5b7c9f6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.573627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1123/2251] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:48:45 2022] PUT /identity/v3/projects/ff611ae22b84465296d95284293eb467/users/9c44214548d3496891b8cf3e8a33f504/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:45.577866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952a04b-bfb7-4135-93ef-5d328dfdae50 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.588316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952a04b-bfb7-4135-93ef-5d328dfdae50 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.641606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:45.661718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dbc54-0aae-4ac9-b3f5-5b8834ec4504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.662408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dbc54-0aae-4ac9-b3f5-5b8834ec4504 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.662688 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dbc54-0aae-4ac9-b3f5-5b8834ec4504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.662963 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dbc54-0aae-4ac9-b3f5-5b8834ec4504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.663701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dbc54-0aae-4ac9-b3f5-5b8834ec4504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.665339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dbc54-0aae-4ac9-b3f5-5b8834ec4504 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.678889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1129/2252] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:45.680157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d99bdc-c19b-448b-96b7-d286e5b7c9f6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.694036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d99bdc-c19b-448b-96b7-d286e5b7c9f6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.698911 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd0932-1d99-486a-9c20-1e03655d18a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.699826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0932-1d99-486a-9c20-1e03655d18a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.700105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0932-1d99-486a-9c20-1e03655d18a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.700384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd0932-1d99-486a-9c20-1e03655d18a9 admin admin] PATH_INFO: `/v3/projects/ff611ae22b84465296d95284293eb467/users/9c44214548d3496891b8cf3e8a33f504/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.703457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd0932-1d99-486a-9c20-1e03655d18a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff611ae22b84465296d95284293eb467, user_id=9c44214548d3496891b8cf3e8a33f504, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.708058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd0932-1d99-486a-9c20-1e03655d18a9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.727509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1124/2253] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:48:45 2022] PUT /identity/v3/projects/ff611ae22b84465296d95284293eb467/users/9c44214548d3496891b8cf3e8a33f504/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:47.467277 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f002ac-526f-48ad-8308-c80ebcee905b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:47.467739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f002ac-526f-48ad-8308-c80ebcee905b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:47.468115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f002ac-526f-48ad-8308-c80ebcee905b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:47.500419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-54f002ac-526f-48ad-8308-c80ebcee905b None None] MFA Rules not processed for user `9c44214548d3496891b8cf3e8a33f504`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:47.501651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-54f002ac-526f-48ad-8308-c80ebcee905b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:47.572713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1130/2254] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:47.584131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd0932-1d99-486a-9c20-1e03655d18a9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:47.585771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cbdd0932-1d99-486a-9c20-1e03655d18a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:47.643426 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd0932-1d99-486a-9c20-1e03655d18a9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:47.647087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df63014-cdc8-46ec-b041-146056a8db83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:47.647718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df63014-cdc8-46ec-b041-146056a8db83 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:47.648003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df63014-cdc8-46ec-b041-146056a8db83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:47.648279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df63014-cdc8-46ec-b041-146056a8db83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:47.712483 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:47.721050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df63014-cdc8-46ec-b041-146056a8db83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:47.722515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df63014-cdc8-46ec-b041-146056a8db83 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:47.732117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1125/2255] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:48.763233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1f71f-fbb0-44f9-919f-15754c295e3d None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:48.763761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1f71f-fbb0-44f9-919f-15754c295e3d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:48.763761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1f71f-fbb0-44f9-919f-15754c295e3d None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:48.765325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1131/2256] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:48:48.772453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13064848-ef9d-425c-b835-08f1c2575435 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:48.772949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13064848-ef9d-425c-b835-08f1c2575435 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:48.773200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13064848-ef9d-425c-b835-08f1c2575435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:48.822705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-13064848-ef9d-425c-b835-08f1c2575435 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:48.823924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-13064848-ef9d-425c-b835-08f1c2575435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:48.902541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1126/2257] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:48.914912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1f71f-fbb0-44f9-919f-15754c295e3d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:48.916590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-93f1f71f-fbb0-44f9-919f-15754c295e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:48.998563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1f71f-fbb0-44f9-919f-15754c295e3d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:49.002179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60c4d4-665c-4838-bd08-f399d95ece23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079eeefcd0654dfe9cd4a9c51d239298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:49.002805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60c4d4-665c-4838-bd08-f399d95ece23 service glance] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.003090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60c4d4-665c-4838-bd08-f399d95ece23 service glance] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.003363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60c4d4-665c-4838-bd08-f399d95ece23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.013541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60c4d4-665c-4838-bd08-f399d95ece23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:49.015003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60c4d4-665c-4838-bd08-f399d95ece23 service glance] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:49.026324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1132/2258] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:49.288065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a12b38-73aa-4ff4-9812-781b14cc2a18 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.288359 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a12b38-73aa-4ff4-9812-781b14cc2a18 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.288647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a12b38-73aa-4ff4-9812-781b14cc2a18 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.290056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1127/2259] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:48:49.294726 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf25c-e7ee-4850-ae00-e8113f63fc62 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.295029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf25c-e7ee-4850-ae00-e8113f63fc62 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.295301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf25c-e7ee-4850-ae00-e8113f63fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.313345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-65adf25c-e7ee-4850-ae00-e8113f63fc62 None None] MFA Rules not processed for user `d7a0dbcea7ef4cdd9134f4c5a9cf5fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:49.314569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-65adf25c-e7ee-4850-ae00-e8113f63fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:49.354754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:49.365565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1133/2260] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:48:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:49.377718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a12b38-73aa-4ff4-9812-781b14cc2a18 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:49.388841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a12b38-73aa-4ff4-9812-781b14cc2a18 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:49.392810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf46f7-3c9f-4556-904e-f4325a023e21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:49.393446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf46f7-3c9f-4556-904e-f4325a023e21 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.393769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf46f7-3c9f-4556-904e-f4325a023e21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.394053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf46f7-3c9f-4556-904e-f4325a023e21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.401337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf46f7-3c9f-4556-904e-f4325a023e21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:49.402802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf46f7-3c9f-4556-904e-f4325a023e21 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:49.411712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1128/2261] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:49.457323 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf25c-e7ee-4850-ae00-e8113f63fc62 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:49.458750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-65adf25c-e7ee-4850-ae00-e8113f63fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:49.471102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf25c-e7ee-4850-ae00-e8113f63fc62 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:49.475447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbd832-6607-42ba-a152-9932b97afe37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:49.476102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd832-6607-42ba-a152-9932b97afe37 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.476518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd832-6607-42ba-a152-9932b97afe37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.476803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbd832-6607-42ba-a152-9932b97afe37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.486404 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbd832-6607-42ba-a152-9932b97afe37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:49.487848 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fbd832-6607-42ba-a152-9932b97afe37 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:49.497312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda0f9-ca12-4ff9-a6c2-88d24f6f03dd None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.497609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda0f9-ca12-4ff9-a6c2-88d24f6f03dd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.497929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eda0f9-ca12-4ff9-a6c2-88d24f6f03dd None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.498370 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1134/2262] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:49 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:49.499376 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1129/2263] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:48:49.504844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65f401-1744-40e3-bf2a-69f71b3606ac None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.505135 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65f401-1744-40e3-bf2a-69f71b3606ac None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.505415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65f401-1744-40e3-bf2a-69f71b3606ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.523651 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0a65f401-1744-40e3-bf2a-69f71b3606ac None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:49.524848 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0a65f401-1744-40e3-bf2a-69f71b3606ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:49.534190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1135/2264] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:48:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:49.545080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eda0f9-ca12-4ff9-a6c2-88d24f6f03dd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:49.550377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-00eda0f9-ca12-4ff9-a6c2-88d24f6f03dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:49.561264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eda0f9-ca12-4ff9-a6c2-88d24f6f03dd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:49.564827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af92ad-68ed-4c7d-92d5-ab5393604347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:49.565459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af92ad-68ed-4c7d-92d5-ab5393604347 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.565771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af92ad-68ed-4c7d-92d5-ab5393604347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.566055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af92ad-68ed-4c7d-92d5-ab5393604347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.576125 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af92ad-68ed-4c7d-92d5-ab5393604347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:49.577516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69af92ad-68ed-4c7d-92d5-ab5393604347 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:49.588702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1130/2265] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:48:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:53.419047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003f462-39b3-4245-8679-95a04dbe51bc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:53.419594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003f462-39b3-4245-8679-95a04dbe51bc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:53.419594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003f462-39b3-4245-8679-95a04dbe51bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:53.438190 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f003f462-39b3-4245-8679-95a04dbe51bc None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:53.439497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f003f462-39b3-4245-8679-95a04dbe51bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:53.500138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1136/2266] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:48:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:53.513893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af92ad-68ed-4c7d-92d5-ab5393604347 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:53.515287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-69af92ad-68ed-4c7d-92d5-ab5393604347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:53.585323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69af92ad-68ed-4c7d-92d5-ab5393604347 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:53.591032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732324ff-0efa-4d38-947d-e63ef13563aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:53.591671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732324ff-0efa-4d38-947d-e63ef13563aa service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:53.591980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732324ff-0efa-4d38-947d-e63ef13563aa service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:53.592253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732324ff-0efa-4d38-947d-e63ef13563aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:53.601936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732324ff-0efa-4d38-947d-e63ef13563aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:53.603546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732324ff-0efa-4d38-947d-e63ef13563aa service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:53.611674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1131/2267] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:48:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:49:03.493162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=37 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:03.608353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:05.797718 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1eccc-02ae-4811-a6eb-5d1fb826eac2 None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:05.798284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1eccc-02ae-4811-a6eb-5d1fb826eac2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:05.798646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1eccc-02ae-4811-a6eb-5d1fb826eac2 None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:05.800658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1137/2268] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:49:05.833031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aab4b-ef0b-4790-8a83-f116ad98a7c6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:05.833619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aab4b-ef0b-4790-8a83-f116ad98a7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:05.833852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6aab4b-ef0b-4790-8a83-f116ad98a7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:05.889559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ba6aab4b-ef0b-4790-8a83-f116ad98a7c6 None None] MFA Rules not processed for user `0412209ee10a46558a8baf10b59f89a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:05.891215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ba6aab4b-ef0b-4790-8a83-f116ad98a7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:05.915659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1eccc-02ae-4811-a6eb-5d1fb826eac2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:05.990670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1132/2269] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:49:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:05.996888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1eccc-02ae-4811-a6eb-5d1fb826eac2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:06.002433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aab4b-ef0b-4790-8a83-f116ad98a7c6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:06.007846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:06.008016 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ba6aab4b-ef0b-4790-8a83-f116ad98a7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:06.008115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:06.008115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:06.008115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] PATH_INFO: `/v3/users/1aaba5c0d96d48f386049565a5cd3f4d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:06.008115 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aaba5c0d96d48f386049565a5cd3f4d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:06.009412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:06.020188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6aab4b-ef0b-4790-8a83-f116ad98a7c6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:06.026278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6878af-41af-4bde-b5a3-3d37c8318ad6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:06.026935 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6878af-41af-4bde-b5a3-3d37c8318ad6 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:06.027546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6878af-41af-4bde-b5a3-3d37c8318ad6 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:06.027546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6878af-41af-4bde-b5a3-3d37c8318ad6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:06.036703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6878af-41af-4bde-b5a3-3d37c8318ad6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:06.038541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6878af-41af-4bde-b5a3-3d37c8318ad6 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:06.048727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1133/2270] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:49:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:06.251868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aaba5c0d96d48f386049565a5cd3f4d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:06.252786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aaba5c0d96d48f386049565a5cd3f4d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:06.338944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aaba5c0d96d48f386049565a5cd3f4d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:06.339673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aaba5c0d96d48f386049565a5cd3f4d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:06.352862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aaba5c0d96d48f386049565a5cd3f4d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:06.366092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1138/2271] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:49:05 2022] DELETE /identity/v3/users/1aaba5c0d96d48f386049565a5cd3f4d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:06.632529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6878af-41af-4bde-b5a3-3d37c8318ad6 service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:06.644562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6878af-41af-4bde-b5a3-3d37c8318ad6 service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:06.705680 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:06.706560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:06.706842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:06.707116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] PATH_INFO: `/v3/projects/0b00a1ff347942be83188a64f75fd04b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:06.708417 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b00a1ff347942be83188a64f75fd04b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:06.710352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:06.784329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:06.785767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:06.859490 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2f45a-38f0-409e-83d4-5b7b525c8d67 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:06.864593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75b6e7-5be2-43b3-8d36-64853e6f414f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:06.865245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b6e7-5be2-43b3-8d36-64853e6f414f service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:06.865528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b6e7-5be2-43b3-8d36-64853e6f414f service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:06.865830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75b6e7-5be2-43b3-8d36-64853e6f414f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:06.869760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ec75b6e7-5be2-43b3-8d36-64853e6f414f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:06.880131 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75b6e7-5be2-43b3-8d36-64853e6f414f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:06.882174 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75b6e7-5be2-43b3-8d36-64853e6f414f service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:06.893178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1139/2272] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:49:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:06.902977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b00a1ff347942be83188a64f75fd04b', 'request_id': 'req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:06.905956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:06.912187 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b00a1ff347942be83188a64f75fd04b', 'request_id': 'req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:06.920751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b00a1ff347942be83188a64f75fd04b', 'request_id': 'req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:07.005889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] The token cache is being invalidate because project 0b00a1ff347942be83188a64f75fd04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:07.006108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:07.006755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:07.008339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1134/2273] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:49:06 2022] DELETE /identity/v3/projects/0b00a1ff347942be83188a64f75fd04b => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:07.012291 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75b6e7-5be2-43b3-8d36-64853e6f414f service placement] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:07.013692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ec75b6e7-5be2-43b3-8d36-64853e6f414f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:07.027327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75b6e7-5be2-43b3-8d36-64853e6f414f service placement] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:07.031815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:07.088669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:07.089548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:07.089901 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:07.090185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] PATH_INFO: `/v3/users/9c44214548d3496891b8cf3e8a33f504` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:07.091396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c44214548d3496891b8cf3e8a33f504)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:07.093320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:07.347903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c44214548d3496891b8cf3e8a33f504'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:07.348616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c44214548d3496891b8cf3e8a33f504'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:07.434540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c44214548d3496891b8cf3e8a33f504'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:07.435177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c44214548d3496891b8cf3e8a33f504'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:07.448542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-43398304-face-4d78-a03f-0eb83770cd97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c44214548d3496891b8cf3e8a33f504'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:07.461236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1140/2274] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:49:07 2022] DELETE /identity/v3/users/9c44214548d3496891b8cf3e8a33f504 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:07.735359 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:07.736926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:07.752105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09a1cc-eb04-40d1-9df8-874d56b87bf6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:07.815351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:07.816122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:07.816404 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:07.816682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] PATH_INFO: `/v3/projects/ff611ae22b84465296d95284293eb467` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:07.817875 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff611ae22b84465296d95284293eb467)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:07.819790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:07.940167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff611ae22b84465296d95284293eb467', 'request_id': 'req-de1745a0-c37b-424d-83ed-04e5e77f6814'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:07.946278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff611ae22b84465296d95284293eb467', 'request_id': 'req-de1745a0-c37b-424d-83ed-04e5e77f6814'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:07.952446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff611ae22b84465296d95284293eb467', 'request_id': 'req-de1745a0-c37b-424d-83ed-04e5e77f6814'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:08.053286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] The token cache is being invalidate because project ff611ae22b84465296d95284293eb467 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:08.053582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:08.054238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-de1745a0-c37b-424d-83ed-04e5e77f6814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:08.055815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1135/2275] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:49:07 2022] DELETE /identity/v3/projects/ff611ae22b84465296d95284293eb467 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:08.063716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358800e-124f-4246-9d83-6909b77fa7a0 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:08.063716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358800e-124f-4246-9d83-6909b77fa7a0 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:08.063716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358800e-124f-4246-9d83-6909b77fa7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:08.092084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b358800e-124f-4246-9d83-6909b77fa7a0 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:08.092084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b358800e-124f-4246-9d83-6909b77fa7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:08.147596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1141/2276] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:08.155864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d86a3-0fbc-4488-8a94-952309d6a9b1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:08.156163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d86a3-0fbc-4488-8a94-952309d6a9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:08.156451 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d86a3-0fbc-4488-8a94-952309d6a9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:08.175578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9a1d86a3-0fbc-4488-8a94-952309d6a9b1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:08.176787 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9a1d86a3-0fbc-4488-8a94-952309d6a9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:08.184729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1136/2277] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:08.189018 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358800e-124f-4246-9d83-6909b77fa7a0 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:08.199419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358800e-124f-4246-9d83-6909b77fa7a0 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:08.203956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71449cb0-1635-41e7-bb04-df5eb2310922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:08.204599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71449cb0-1635-41e7-bb04-df5eb2310922 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:08.204880 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71449cb0-1635-41e7-bb04-df5eb2310922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:08.205156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71449cb0-1635-41e7-bb04-df5eb2310922 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:08.205912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71449cb0-1635-41e7-bb04-df5eb2310922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:08.206225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71449cb0-1635-41e7-bb04-df5eb2310922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:08.207858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71449cb0-1635-41e7-bb04-df5eb2310922 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:08.220134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1142/2278] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:49:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:49:08.224737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d86a3-0fbc-4488-8a94-952309d6a9b1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:08.233878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d86a3-0fbc-4488-8a94-952309d6a9b1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:08.238638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4b07-4f5c-4e6b-9b78-fa5f4dee9312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:08.239289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4b07-4f5c-4e6b-9b78-fa5f4dee9312 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:08.239573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4b07-4f5c-4e6b-9b78-fa5f4dee9312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:08.239853 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4b07-4f5c-4e6b-9b78-fa5f4dee9312 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:08.240574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae4b07-4f5c-4e6b-9b78-fa5f4dee9312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:08.242533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae4b07-4f5c-4e6b-9b78-fa5f4dee9312 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:08.367082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1137/2279] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:49:08 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:08.368140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71449cb0-1635-41e7-bb04-df5eb2310922 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:08.378085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71449cb0-1635-41e7-bb04-df5eb2310922 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:08.390222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:08.433855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb662a6-ace3-490b-83a3-a09cf89768c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:08.434528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb662a6-ace3-490b-83a3-a09cf89768c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:08.434813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb662a6-ace3-490b-83a3-a09cf89768c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:08.435089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb662a6-ace3-490b-83a3-a09cf89768c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:08.435786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb662a6-ace3-490b-83a3-a09cf89768c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:08.437725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb662a6-ace3-490b-83a3-a09cf89768c7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:08.555481 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1143/2280] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:49:08 2022] POST /identity/v3/users => generated 292 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:08.559332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4b07-4f5c-4e6b-9b78-fa5f4dee9312 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:08.569551 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4b07-4f5c-4e6b-9b78-fa5f4dee9312 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:08.574865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cedfe-04f8-4ad8-ad51-ba236392c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:08.575522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cedfe-04f8-4ad8-ad51-ba236392c534 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:08.575809 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cedfe-04f8-4ad8-ad51-ba236392c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:08.576086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cedfe-04f8-4ad8-ad51-ba236392c534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:08.576807 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cedfe-04f8-4ad8-ad51-ba236392c534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:08.578446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cedfe-04f8-4ad8-ad51-ba236392c534 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:08.590178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1138/2281] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:49:08.594180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb662a6-ace3-490b-83a3-a09cf89768c7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:08.604497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb662a6-ace3-490b-83a3-a09cf89768c7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:08.609003 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6da66-6676-4803-8818-d724d522c31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:08.609655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6da66-6676-4803-8818-d724d522c31a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:08.609974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6da66-6676-4803-8818-d724d522c31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:08.610255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6da66-6676-4803-8818-d724d522c31a admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:08.610979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6da66-6676-4803-8818-d724d522c31a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:08.612571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6da66-6676-4803-8818-d724d522c31a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:08.623262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1144/2282] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:08.627123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cedfe-04f8-4ad8-ad51-ba236392c534 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:08.637536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cedfe-04f8-4ad8-ad51-ba236392c534 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:08.642171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d6dc2-c9c3-4db2-9cf8-bad03b356618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:08.643039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d6dc2-c9c3-4db2-9cf8-bad03b356618 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:08.643330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d6dc2-c9c3-4db2-9cf8-bad03b356618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:08.643612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d6dc2-c9c3-4db2-9cf8-bad03b356618 admin admin] PATH_INFO: `/v3/projects/f758f87413a947efb79f5bb3a6c95e80/users/7b664cf0ebf7435e9e8334d502b58e99/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:08.658412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d6dc2-c9c3-4db2-9cf8-bad03b356618 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f758f87413a947efb79f5bb3a6c95e80, user_id=7b664cf0ebf7435e9e8334d502b58e99, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:08.661031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d6dc2-c9c3-4db2-9cf8-bad03b356618 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:08.762592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1139/2283] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:49:08 2022] PUT /identity/v3/projects/f758f87413a947efb79f5bb3a6c95e80/users/7b664cf0ebf7435e9e8334d502b58e99/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:08.772879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e50fd6-5ba8-4cef-bdd1-7f71c54597a1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:08.773176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e50fd6-5ba8-4cef-bdd1-7f71c54597a1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:08.773463 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e50fd6-5ba8-4cef-bdd1-7f71c54597a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:08.800096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-c3e50fd6-5ba8-4cef-bdd1-7f71c54597a1 None None] MFA Rules not processed for user `7b664cf0ebf7435e9e8334d502b58e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:08.801311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c3e50fd6-5ba8-4cef-bdd1-7f71c54597a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:08.867200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1145/2284] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:49:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:08.877638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d6dc2-c9c3-4db2-9cf8-bad03b356618 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:08.879312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4e4d6dc2-c9c3-4db2-9cf8-bad03b356618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:08.889048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:08.936299 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d6dc2-c9c3-4db2-9cf8-bad03b356618 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:08.940104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e6b31-0773-416d-a6bb-6445afca8e4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:08.940752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e6b31-0773-416d-a6bb-6445afca8e4b service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:08.941287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e6b31-0773-416d-a6bb-6445afca8e4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:08.941287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e6b31-0773-416d-a6bb-6445afca8e4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:08.950237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e6b31-0773-416d-a6bb-6445afca8e4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:08.951653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98e6b31-0773-416d-a6bb-6445afca8e4b service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:08.960895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1140/2285] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:49:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:18.863778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=59,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:18.973296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=23 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:21.733144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff397ef-d245-49b4-bfdb-23340453a411 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:21.733628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff397ef-d245-49b4-bfdb-23340453a411 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:21.733784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff397ef-d245-49b4-bfdb-23340453a411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:21.751661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-aff397ef-d245-49b4-bfdb-23340453a411 None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:21.752908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aff397ef-d245-49b4-bfdb-23340453a411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:21.809845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1146/2286] 10.222.0.41 () {58 vars in 967 bytes} [Thu May 26 12:49:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:21.823826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e6b31-0773-416d-a6bb-6445afca8e4b service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:21.825233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a98e6b31-0773-416d-a6bb-6445afca8e4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:21.895416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e6b31-0773-416d-a6bb-6445afca8e4b service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:21.901097 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d232179a-b53a-4323-a607-34f719c00ad4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:21.901789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232179a-b53a-4323-a607-34f719c00ad4 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:21.902089 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232179a-b53a-4323-a607-34f719c00ad4 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:21.902369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d232179a-b53a-4323-a607-34f719c00ad4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:21.911510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232179a-b53a-4323-a607-34f719c00ad4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:21.923674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d232179a-b53a-4323-a607-34f719c00ad4 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:21.923674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1141/2287] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:49:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:49:22.208659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff397ef-d245-49b4-bfdb-23340453a411 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:22.270841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff397ef-d245-49b4-bfdb-23340453a411 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:22.275577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:22.276457 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:22.280108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:22.280108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] PATH_INFO: `/v3/users/7b664cf0ebf7435e9e8334d502b58e99` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:22.280108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b664cf0ebf7435e9e8334d502b58e99)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:22.280414 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:22.560809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b664cf0ebf7435e9e8334d502b58e99'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:22.560809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b664cf0ebf7435e9e8334d502b58e99'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:22.657306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b664cf0ebf7435e9e8334d502b58e99'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:22.658027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b664cf0ebf7435e9e8334d502b58e99'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:22.671337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b664cf0ebf7435e9e8334d502b58e99'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:22.684359 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1147/2288] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:49:22 2022] DELETE /identity/v3/users/7b664cf0ebf7435e9e8334d502b58e99 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:22.689118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50662947-6dda-48da-a1bf-4399fcc16c47 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:22.689358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50662947-6dda-48da-a1bf-4399fcc16c47 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:22.689640 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50662947-6dda-48da-a1bf-4399fcc16c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:22.708439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-50662947-6dda-48da-a1bf-4399fcc16c47 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:22.709734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-50662947-6dda-48da-a1bf-4399fcc16c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:22.782924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1142/2289] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:22.793222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:22.794731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:22.823722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:22.854281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b40b3f-cc06-49bc-848f-8f8175a86e4a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:22.858378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03012dc9-55fe-4c7a-b390-471cf9a24889 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:22.859043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03012dc9-55fe-4c7a-b390-471cf9a24889 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:22.859363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03012dc9-55fe-4c7a-b390-471cf9a24889 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:22.859649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03012dc9-55fe-4c7a-b390-471cf9a24889 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:22.869689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03012dc9-55fe-4c7a-b390-471cf9a24889 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:22.871122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03012dc9-55fe-4c7a-b390-471cf9a24889 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:22.881601 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1148/2290] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:23.373175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50662947-6dda-48da-a1bf-4399fcc16c47 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:23.374842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-50662947-6dda-48da-a1bf-4399fcc16c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:23.386938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50662947-6dda-48da-a1bf-4399fcc16c47 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:23.395487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:23.396385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:23.396675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:23.396959 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] PATH_INFO: `/v3/projects/f758f87413a947efb79f5bb3a6c95e80` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:23.398227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f758f87413a947efb79f5bb3a6c95e80)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:23.400147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:23.522137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f758f87413a947efb79f5bb3a6c95e80', 'request_id': 'req-6f066b2b-3af2-42c1-97b1-0be718864fdc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:23.527506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f758f87413a947efb79f5bb3a6c95e80', 'request_id': 'req-6f066b2b-3af2-42c1-97b1-0be718864fdc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:23.533573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f758f87413a947efb79f5bb3a6c95e80', 'request_id': 'req-6f066b2b-3af2-42c1-97b1-0be718864fdc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:23.607603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] The token cache is being invalidate because project f758f87413a947efb79f5bb3a6c95e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:23.607941 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:23.608517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6f066b2b-3af2-42c1-97b1-0be718864fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:23.610096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1143/2291] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:49:23 2022] DELETE /identity/v3/projects/f758f87413a947efb79f5bb3a6c95e80 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:23.615095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b380e-ebbd-45e4-a066-d1191cea591e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:23.615395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b380e-ebbd-45e4-a066-d1191cea591e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:23.615674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b380e-ebbd-45e4-a066-d1191cea591e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:23.633922 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b10b380e-ebbd-45e4-a066-d1191cea591e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:23.635372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b10b380e-ebbd-45e4-a066-d1191cea591e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:23.693807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1149/2292] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:23.702511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6bca-5052-4f83-9977-788376906e33 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:23.702802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6bca-5052-4f83-9977-788376906e33 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:23.703080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b6bca-5052-4f83-9977-788376906e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:23.721591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7e8b6bca-5052-4f83-9977-788376906e33 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:23.722823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7e8b6bca-5052-4f83-9977-788376906e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:23.731590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1144/2293] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:23.735865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b380e-ebbd-45e4-a066-d1191cea591e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:23.746362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b380e-ebbd-45e4-a066-d1191cea591e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:23.750913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739a981-45b1-4e40-aa26-d20ac33ca9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:23.751574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739a981-45b1-4e40-aa26-d20ac33ca9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:23.751909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739a981-45b1-4e40-aa26-d20ac33ca9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:23.752188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739a981-45b1-4e40-aa26-d20ac33ca9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:23.752978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739a981-45b1-4e40-aa26-d20ac33ca9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:23.753344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739a981-45b1-4e40-aa26-d20ac33ca9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:23.754989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739a981-45b1-4e40-aa26-d20ac33ca9eb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:23.766470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1150/2294] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:49:23.770785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b6bca-5052-4f83-9977-788376906e33 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:23.780763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b6bca-5052-4f83-9977-788376906e33 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:23.785576 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cc2b9-8a12-48ad-86ea-e25ade3692e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:23.786260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cc2b9-8a12-48ad-86ea-e25ade3692e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:23.786550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cc2b9-8a12-48ad-86ea-e25ade3692e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:23.786833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cc2b9-8a12-48ad-86ea-e25ade3692e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:23.787565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cc2b9-8a12-48ad-86ea-e25ade3692e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:23.790111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cc2b9-8a12-48ad-86ea-e25ade3692e7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:23.793525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:23.888859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1145/2295] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:49:23 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:23.893207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739a981-45b1-4e40-aa26-d20ac33ca9eb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:23.903869 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739a981-45b1-4e40-aa26-d20ac33ca9eb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:23.961958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160e59c-c35f-4e04-bfb9-1dadfd7695ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:23.962624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160e59c-c35f-4e04-bfb9-1dadfd7695ae admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:23.962909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160e59c-c35f-4e04-bfb9-1dadfd7695ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:23.963187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160e59c-c35f-4e04-bfb9-1dadfd7695ae admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:23.963881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160e59c-c35f-4e04-bfb9-1dadfd7695ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:23.965833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b160e59c-c35f-4e04-bfb9-1dadfd7695ae admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:24.047775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1151/2296] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:49:23 2022] POST /identity/v3/users => generated 284 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:24.051724 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cc2b9-8a12-48ad-86ea-e25ade3692e7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:24.062117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cc2b9-8a12-48ad-86ea-e25ade3692e7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:24.066727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf7ee4-d1e9-4adf-ad1f-983dbcb42923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:24.067379 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf7ee4-d1e9-4adf-ad1f-983dbcb42923 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:24.067666 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf7ee4-d1e9-4adf-ad1f-983dbcb42923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:24.067947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf7ee4-d1e9-4adf-ad1f-983dbcb42923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:24.068669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf7ee4-d1e9-4adf-ad1f-983dbcb42923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:24.070302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf7ee4-d1e9-4adf-ad1f-983dbcb42923 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:24.082647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1146/2297] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:24.087745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160e59c-c35f-4e04-bfb9-1dadfd7695ae admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:24.099224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160e59c-c35f-4e04-bfb9-1dadfd7695ae admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:24.102432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2fd967-7b62-45c2-ac64-d909ea7e8c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:24.103080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fd967-7b62-45c2-ac64-d909ea7e8c53 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:24.103362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fd967-7b62-45c2-ac64-d909ea7e8c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:24.103640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2fd967-7b62-45c2-ac64-d909ea7e8c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:24.104365 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fd967-7b62-45c2-ac64-d909ea7e8c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:24.106033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2fd967-7b62-45c2-ac64-d909ea7e8c53 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:24.116152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1152/2298] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:24.120283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf7ee4-d1e9-4adf-ad1f-983dbcb42923 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:24.130336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf7ee4-d1e9-4adf-ad1f-983dbcb42923 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:24.135622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96229092-9a4c-491f-8117-51a2d410c48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:24.136500 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96229092-9a4c-491f-8117-51a2d410c48d admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:24.136786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96229092-9a4c-491f-8117-51a2d410c48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:24.137068 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96229092-9a4c-491f-8117-51a2d410c48d admin admin] PATH_INFO: `/v3/projects/d6c12f3355474f5ba9555a2ce62b46fe/users/42e93685a0ba47e490ed8a1752841dd1/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:24.152415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96229092-9a4c-491f-8117-51a2d410c48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c12f3355474f5ba9555a2ce62b46fe, user_id=42e93685a0ba47e490ed8a1752841dd1, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:24.155093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96229092-9a4c-491f-8117-51a2d410c48d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:24.300052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1147/2299] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:49:24 2022] PUT /identity/v3/projects/d6c12f3355474f5ba9555a2ce62b46fe/users/42e93685a0ba47e490ed8a1752841dd1/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:24.310459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedb9ec-170a-45ad-958a-4cc4b7d5a9a2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:24.310756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedb9ec-170a-45ad-958a-4cc4b7d5a9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:24.311043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedb9ec-170a-45ad-958a-4cc4b7d5a9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:24.338205 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3dedb9ec-170a-45ad-958a-4cc4b7d5a9a2 None None] MFA Rules not processed for user `42e93685a0ba47e490ed8a1752841dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:24.339410 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3dedb9ec-170a-45ad-958a-4cc4b7d5a9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:24.359608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:24.406367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1153/2300] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:49:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:24.418176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96229092-9a4c-491f-8117-51a2d410c48d admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:24.419967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-96229092-9a4c-491f-8117-51a2d410c48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:24.484019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96229092-9a4c-491f-8117-51a2d410c48d admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:24.488138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e6925-bd9a-4e7a-b8a7-05bef85f672a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079eeefcd0654dfe9cd4a9c51d239298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:24.488796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e6925-bd9a-4e7a-b8a7-05bef85f672a service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:24.489081 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e6925-bd9a-4e7a-b8a7-05bef85f672a service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:24.489359 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e6925-bd9a-4e7a-b8a7-05bef85f672a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:24.498894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e6925-bd9a-4e7a-b8a7-05bef85f672a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:24.500339 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e6925-bd9a-4e7a-b8a7-05bef85f672a service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:24.510232 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1148/2301] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:49:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:34.436042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=17 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:34.505405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:53.635451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66a0e-051d-4621-a928-cb7022f1f64d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:53.635954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66a0e-051d-4621-a928-cb7022f1f64d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:53.636043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66a0e-051d-4621-a928-cb7022f1f64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:53.653940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8ef66a0e-051d-4621-a928-cb7022f1f64d None None] MFA Rules not processed for user `646a9abb1f9d4a1295a04defd895ff7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:53.654962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8ef66a0e-051d-4621-a928-cb7022f1f64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:53.709154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1154/2302] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:49:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:03.702234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=25 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:09.834651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e6925-bd9a-4e7a-b8a7-05bef85f672a service glance] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:09.933871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e6925-bd9a-4e7a-b8a7-05bef85f672a service glance] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:09.940870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:09.941360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:09.941646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:09.941964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] PATH_INFO: `/v3/users/42e93685a0ba47e490ed8a1752841dd1` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:09.943281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e93685a0ba47e490ed8a1752841dd1)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:09.945658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:10.220323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e93685a0ba47e490ed8a1752841dd1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:10.310440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e93685a0ba47e490ed8a1752841dd1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:10.318384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e93685a0ba47e490ed8a1752841dd1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:10.318384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e93685a0ba47e490ed8a1752841dd1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:10.326692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e93685a0ba47e490ed8a1752841dd1'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:10.340035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1149/2303] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:50:09 2022] DELETE /identity/v3/users/42e93685a0ba47e490ed8a1752841dd1 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:10.346763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1b8b0-5b47-4118-91fe-17ff5c7630d9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:10.346763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1b8b0-5b47-4118-91fe-17ff5c7630d9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:10.346763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1b8b0-5b47-4118-91fe-17ff5c7630d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:10.367471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d8f1b8b0-5b47-4118-91fe-17ff5c7630d9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:10.368627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8f1b8b0-5b47-4118-91fe-17ff5c7630d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:10.432676 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1155/2304] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:10.444027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:10.445630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:10.534267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a02709-eeea-4821-b0e4-3a2ba79e342c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:10.542314 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e09bc2-fbbe-4fbd-a6b9-2cc7055c66b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:10.543161 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e09bc2-fbbe-4fbd-a6b9-2cc7055c66b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:10.543452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e09bc2-fbbe-4fbd-a6b9-2cc7055c66b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:10.543732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e09bc2-fbbe-4fbd-a6b9-2cc7055c66b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:10.559120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e09bc2-fbbe-4fbd-a6b9-2cc7055c66b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:10.559120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e09bc2-fbbe-4fbd-a6b9-2cc7055c66b6 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:10.578630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1150/2305] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:11.188991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1b8b0-5b47-4118-91fe-17ff5c7630d9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:11.188991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d8f1b8b0-5b47-4118-91fe-17ff5c7630d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:11.214634 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1b8b0-5b47-4118-91fe-17ff5c7630d9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:11.221468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:11.222753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:11.223518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:11.224011 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] PATH_INFO: `/v3/projects/d6c12f3355474f5ba9555a2ce62b46fe` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:11.246311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c12f3355474f5ba9555a2ce62b46fe)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:11.246311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:11.395514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c12f3355474f5ba9555a2ce62b46fe', 'request_id': 'req-09792310-96d3-41b8-b172-dd8ea5a8dbd2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:11.407874 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c12f3355474f5ba9555a2ce62b46fe', 'request_id': 'req-09792310-96d3-41b8-b172-dd8ea5a8dbd2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:11.416580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c12f3355474f5ba9555a2ce62b46fe', 'request_id': 'req-09792310-96d3-41b8-b172-dd8ea5a8dbd2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:11.577491 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] The token cache is being invalidate because project d6c12f3355474f5ba9555a2ce62b46fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:50:11.583943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:11.583943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-09792310-96d3-41b8-b172-dd8ea5a8dbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:11.583943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1156/2306] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:50:11 2022] DELETE /identity/v3/projects/d6c12f3355474f5ba9555a2ce62b46fe => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:11.585260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20701783-557e-4eee-a16c-d8df60601e15 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:11.585741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20701783-557e-4eee-a16c-d8df60601e15 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:11.585908 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20701783-557e-4eee-a16c-d8df60601e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:11.606896 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-20701783-557e-4eee-a16c-d8df60601e15 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:11.608169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-20701783-557e-4eee-a16c-d8df60601e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:11.636198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:11.690314 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1151/2307] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:11.700223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fc97-411a-4cf6-8f10-e38caa4c7a04 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:11.700512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fc97-411a-4cf6-8f10-e38caa4c7a04 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:11.700792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597fc97-411a-4cf6-8f10-e38caa4c7a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:11.721346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7597fc97-411a-4cf6-8f10-e38caa4c7a04 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:11.722608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7597fc97-411a-4cf6-8f10-e38caa4c7a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:11.731661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1157/2308] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:11.737119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20701783-557e-4eee-a16c-d8df60601e15 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:11.749934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20701783-557e-4eee-a16c-d8df60601e15 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:11.754832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cb528-8c4b-4e7f-ab51-ee3a7deb0ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:11.755582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cb528-8c4b-4e7f-ab51-ee3a7deb0ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:11.755888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cb528-8c4b-4e7f-ab51-ee3a7deb0ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:11.756178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cb528-8c4b-4e7f-ab51-ee3a7deb0ed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:11.756949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cb528-8c4b-4e7f-ab51-ee3a7deb0ed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:50:11.757274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cb528-8c4b-4e7f-ab51-ee3a7deb0ed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:11.759477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cb528-8c4b-4e7f-ab51-ee3a7deb0ed5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:11.775506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1152/2309] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:50:11.780283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597fc97-411a-4cf6-8f10-e38caa4c7a04 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:11.788761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597fc97-411a-4cf6-8f10-e38caa4c7a04 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:11.793904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fe059-29f7-460d-90f0-1909b00dd45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:11.794596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fe059-29f7-460d-90f0-1909b00dd45f admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:11.795001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fe059-29f7-460d-90f0-1909b00dd45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:11.795288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fe059-29f7-460d-90f0-1909b00dd45f admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:11.796229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fe059-29f7-460d-90f0-1909b00dd45f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:11.797993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fe059-29f7-460d-90f0-1909b00dd45f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:11.900375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1158/2310] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:50:11 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:11.904486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cb528-8c4b-4e7f-ab51-ee3a7deb0ed5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:11.914689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cb528-8c4b-4e7f-ab51-ee3a7deb0ed5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:11.977584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd618b-7654-4d73-bc3e-e0cd81fb35c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:11.978301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd618b-7654-4d73-bc3e-e0cd81fb35c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:11.978584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd618b-7654-4d73-bc3e-e0cd81fb35c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:11.978859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd618b-7654-4d73-bc3e-e0cd81fb35c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:11.979571 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd618b-7654-4d73-bc3e-e0cd81fb35c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:11.981875 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd618b-7654-4d73-bc3e-e0cd81fb35c2 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:12.076735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1153/2311] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:50:11 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:12.081048 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fe059-29f7-460d-90f0-1909b00dd45f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:12.091884 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fe059-29f7-460d-90f0-1909b00dd45f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:12.096641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b17cd-7b45-458a-99d0-264b2e509dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:12.097309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b17cd-7b45-458a-99d0-264b2e509dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.097596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b17cd-7b45-458a-99d0-264b2e509dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.097913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b17cd-7b45-458a-99d0-264b2e509dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.098907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b17cd-7b45-458a-99d0-264b2e509dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:12.100516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b17cd-7b45-458a-99d0-264b2e509dbb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:12.111917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1159/2312] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:12.116023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd618b-7654-4d73-bc3e-e0cd81fb35c2 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:12.126698 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd618b-7654-4d73-bc3e-e0cd81fb35c2 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:12.131870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c25812-a6f0-4620-84b8-7595ab7518ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:12.132527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c25812-a6f0-4620-84b8-7595ab7518ac admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.132835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c25812-a6f0-4620-84b8-7595ab7518ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.133114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c25812-a6f0-4620-84b8-7595ab7518ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.133867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c25812-a6f0-4620-84b8-7595ab7518ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:12.135456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c25812-a6f0-4620-84b8-7595ab7518ac admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:12.145579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1154/2313] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:50:12.149746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b17cd-7b45-458a-99d0-264b2e509dbb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:12.170613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b17cd-7b45-458a-99d0-264b2e509dbb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:12.170613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b958-9c7c-4742-937b-267804120e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:12.170613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b958-9c7c-4742-937b-267804120e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.170613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b958-9c7c-4742-937b-267804120e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.171015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14b958-9c7c-4742-937b-267804120e62 admin admin] PATH_INFO: `/v3/projects/1d62b3d2c50e45a6900da98a8d4f8500/users/0821209b84704635b225d62e64239fb7/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.182425 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14b958-9c7c-4742-937b-267804120e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d62b3d2c50e45a6900da98a8d4f8500, user_id=0821209b84704635b225d62e64239fb7, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:12.185113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14b958-9c7c-4742-937b-267804120e62 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:12.252851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1160/2314] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:50:12 2022] PUT /identity/v3/projects/1d62b3d2c50e45a6900da98a8d4f8500/users/0821209b84704635b225d62e64239fb7/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:12.263053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4988f-f34d-45fb-a668-0d3545515d61 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.263350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4988f-f34d-45fb-a668-0d3545515d61 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.263636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4988f-f34d-45fb-a668-0d3545515d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.292251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d3b4988f-f34d-45fb-a668-0d3545515d61 None None] MFA Rules not processed for user `0821209b84704635b225d62e64239fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:12.296240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d3b4988f-f34d-45fb-a668-0d3545515d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:12.368622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1155/2315] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:12.376451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b958-9c7c-4742-937b-267804120e62 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:12.378550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6a14b958-9c7c-4742-937b-267804120e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:12.401843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:12.440765 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14b958-9c7c-4742-937b-267804120e62 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:12.444508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d042868a-d89e-4a74-be80-7b3b024924fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079eeefcd0654dfe9cd4a9c51d239298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:12.445184 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042868a-d89e-4a74-be80-7b3b024924fb service glance] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.445472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042868a-d89e-4a74-be80-7b3b024924fb service glance] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.445959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d042868a-d89e-4a74-be80-7b3b024924fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.456350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042868a-d89e-4a74-be80-7b3b024924fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:12.457847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d042868a-d89e-4a74-be80-7b3b024924fb service glance] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:12.468341 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1161/2316] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:50:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:17.500428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f10ec6-4659-4910-a548-ef0c6091b448 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:17.500937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f10ec6-4659-4910-a548-ef0c6091b448 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:17.501031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f10ec6-4659-4910-a548-ef0c6091b448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:17.519250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-24f10ec6-4659-4910-a548-ef0c6091b448 None None] MFA Rules not processed for user `0537911b91184fcdbdcc9e93ec3fe5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:17.520518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-24f10ec6-4659-4910-a548-ef0c6091b448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:17.532887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:17.581395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1156/2317] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:22.532723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=17 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:27.850765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=17 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:36.392894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e15c7-abfb-47ec-a3f0-72ae7988a450 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:36.393509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e15c7-abfb-47ec-a3f0-72ae7988a450 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:36.393611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e15c7-abfb-47ec-a3f0-72ae7988a450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:36.412316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a79e15c7-abfb-47ec-a3f0-72ae7988a450 None None] MFA Rules not processed for user `cf98a4d33cab49b08640f437dbfb2dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:36.413683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a79e15c7-abfb-47ec-a3f0-72ae7988a450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:36.470587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1162/2318] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:41.488609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65559e4-f03e-41d8-9b2e-6aa4942e0ed8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:41.489106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65559e4-f03e-41d8-9b2e-6aa4942e0ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:41.489206 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65559e4-f03e-41d8-9b2e-6aa4942e0ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:41.507631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d65559e4-f03e-41d8-9b2e-6aa4942e0ed8 None None] MFA Rules not processed for user `1e83db01f0b24204a61b037b3c1f044c`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:41.510365 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d65559e4-f03e-41d8-9b2e-6aa4942e0ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:41.565382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1157/2319] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:46.463781 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=25 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:47.834933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e15c7-abfb-47ec-a3f0-72ae7988a450 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:47.898569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e15c7-abfb-47ec-a3f0-72ae7988a450 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:47.903312 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:47.904179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:47.904474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:47.904802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] PATH_INFO: `/v3/users/0821209b84704635b225d62e64239fb7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:47.906060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0821209b84704635b225d62e64239fb7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:47.908011 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:48.127632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0821209b84704635b225d62e64239fb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:48.128664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0821209b84704635b225d62e64239fb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:48.262453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0821209b84704635b225d62e64239fb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:48.263286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0821209b84704635b225d62e64239fb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:48.277660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0821209b84704635b225d62e64239fb7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:48.295334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1163/2320] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:50:47 2022] DELETE /identity/v3/users/0821209b84704635b225d62e64239fb7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:48.299943 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fce559-36a0-48a4-bc40-903375dd5a79 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:48.300439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fce559-36a0-48a4-bc40-903375dd5a79 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:48.300546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fce559-36a0-48a4-bc40-903375dd5a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:48.321080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-59fce559-36a0-48a4-bc40-903375dd5a79 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:48.321080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-59fce559-36a0-48a4-bc40-903375dd5a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:48.395287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1158/2321] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:48.407529 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:48.409781 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:48.503974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50b5c3-ccde-4974-a8fb-6cfc95fcb168 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:48.509229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af3e9c-d9c0-4a7c-8989-ea92cc245792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:48.509991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af3e9c-d9c0-4a7c-8989-ea92cc245792 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:48.510311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af3e9c-d9c0-4a7c-8989-ea92cc245792 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:48.510595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af3e9c-d9c0-4a7c-8989-ea92cc245792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:48.524287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af3e9c-d9c0-4a7c-8989-ea92cc245792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:48.529804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af3e9c-d9c0-4a7c-8989-ea92cc245792 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:48.539600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1164/2322] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:49.547213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fce559-36a0-48a4-bc40-903375dd5a79 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:49.548593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-59fce559-36a0-48a4-bc40-903375dd5a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:49.562374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fce559-36a0-48a4-bc40-903375dd5a79 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:49.574767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:49.575733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.576305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.576305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] PATH_INFO: `/v3/projects/1d62b3d2c50e45a6900da98a8d4f8500` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.578423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d62b3d2c50e45a6900da98a8d4f8500)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:49.580658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:49.738877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d62b3d2c50e45a6900da98a8d4f8500', 'request_id': 'req-9b6d451a-9334-4325-862a-559224cb2f28'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:49.747310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d62b3d2c50e45a6900da98a8d4f8500', 'request_id': 'req-9b6d451a-9334-4325-862a-559224cb2f28'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:49.754549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d62b3d2c50e45a6900da98a8d4f8500', 'request_id': 'req-9b6d451a-9334-4325-862a-559224cb2f28'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:49.858126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] The token cache is being invalidate because project 1d62b3d2c50e45a6900da98a8d4f8500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:50:49.858695 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:49.859361 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9b6d451a-9334-4325-862a-559224cb2f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:49.860926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1159/2323] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:50:49 2022] DELETE /identity/v3/projects/1d62b3d2c50e45a6900da98a8d4f8500 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:49.867911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278a573-6795-4ae2-9138-912c9d74b8a3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.868393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278a573-6795-4ae2-9138-912c9d74b8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.868473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278a573-6795-4ae2-9138-912c9d74b8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.886362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0278a573-6795-4ae2-9138-912c9d74b8a3 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:49.887617 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0278a573-6795-4ae2-9138-912c9d74b8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:49.908721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:49.956965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1165/2324] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:49.965874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9c95-575f-444d-b77f-612a3651cf22 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.966321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9c95-575f-444d-b77f-612a3651cf22 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.966668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a9c95-575f-444d-b77f-612a3651cf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.994197 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d22a9c95-575f-444d-b77f-612a3651cf22 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:49.995607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d22a9c95-575f-444d-b77f-612a3651cf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:50.007298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1160/2325] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:50.011534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278a573-6795-4ae2-9138-912c9d74b8a3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:50.023197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278a573-6795-4ae2-9138-912c9d74b8a3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:50.028260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f285903-fce2-4a16-a220-551f1a1e137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:50.029022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f285903-fce2-4a16-a220-551f1a1e137a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:50.029385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f285903-fce2-4a16-a220-551f1a1e137a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:50.029780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f285903-fce2-4a16-a220-551f1a1e137a admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:50.030599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f285903-fce2-4a16-a220-551f1a1e137a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:50:50.031139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f285903-fce2-4a16-a220-551f1a1e137a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:50.032886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f285903-fce2-4a16-a220-551f1a1e137a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:50.058680 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1166/2326] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:50:50.061473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a9c95-575f-444d-b77f-612a3651cf22 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:50.109860 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a9c95-575f-444d-b77f-612a3651cf22 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:50.125575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ad6aa-cf4f-4a0f-b038-e136403daa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:50.126456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ad6aa-cf4f-4a0f-b038-e136403daa20 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:50.126785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ad6aa-cf4f-4a0f-b038-e136403daa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:50.127196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ad6aa-cf4f-4a0f-b038-e136403daa20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:50.127930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ad6aa-cf4f-4a0f-b038-e136403daa20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:50.130038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ad6aa-cf4f-4a0f-b038-e136403daa20 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:50.305323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:50.316467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f285903-fce2-4a16-a220-551f1a1e137a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:50.324171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1161/2327] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:50:50 2022] POST /identity/v3/projects => generated 379 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:50.328685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f285903-fce2-4a16-a220-551f1a1e137a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:50.400808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350bb0e-f81d-4e3f-a5c5-043a92d56724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:50.401494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350bb0e-f81d-4e3f-a5c5-043a92d56724 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:50.401815 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350bb0e-f81d-4e3f-a5c5-043a92d56724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:50.402104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350bb0e-f81d-4e3f-a5c5-043a92d56724 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:50.402856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350bb0e-f81d-4e3f-a5c5-043a92d56724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:50.405346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350bb0e-f81d-4e3f-a5c5-043a92d56724 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:50.517763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1167/2328] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:50:50 2022] POST /identity/v3/users => generated 290 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:50.519298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ad6aa-cf4f-4a0f-b038-e136403daa20 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:50.530674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ad6aa-cf4f-4a0f-b038-e136403daa20 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:50.536251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6c9dd-d453-46ac-9751-74b8ac953b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:50.537146 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6c9dd-d453-46ac-9751-74b8ac953b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:50.537438 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6c9dd-d453-46ac-9751-74b8ac953b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:50.537746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6c9dd-d453-46ac-9751-74b8ac953b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:50.539082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6c9dd-d453-46ac-9751-74b8ac953b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:50.541057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c6c9dd-d453-46ac-9751-74b8ac953b2b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:50.556443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1162/2329] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:50.560379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350bb0e-f81d-4e3f-a5c5-043a92d56724 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:50.577807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350bb0e-f81d-4e3f-a5c5-043a92d56724 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:50.586500 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8818a988-c8ef-4d3d-8fb1-7a12091a50a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:50.590582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818a988-c8ef-4d3d-8fb1-7a12091a50a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:50.590582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818a988-c8ef-4d3d-8fb1-7a12091a50a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:50.590582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818a988-c8ef-4d3d-8fb1-7a12091a50a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:50.590582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818a988-c8ef-4d3d-8fb1-7a12091a50a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:50.592225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8818a988-c8ef-4d3d-8fb1-7a12091a50a2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:50.631800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1168/2330] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:50.636861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6c9dd-d453-46ac-9751-74b8ac953b2b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:50.648476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6c9dd-d453-46ac-9751-74b8ac953b2b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:50.653867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490df8c6-5aeb-4f2f-8aca-3ed956a70130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:50.659957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490df8c6-5aeb-4f2f-8aca-3ed956a70130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:50.659957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490df8c6-5aeb-4f2f-8aca-3ed956a70130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:50.659957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490df8c6-5aeb-4f2f-8aca-3ed956a70130 admin admin] PATH_INFO: `/v3/projects/23568023763549669484e71430e34389/users/b47d51863b0448b880dc03b01dec6dc5/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:50.673027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490df8c6-5aeb-4f2f-8aca-3ed956a70130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23568023763549669484e71430e34389, user_id=b47d51863b0448b880dc03b01dec6dc5, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:50.676087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490df8c6-5aeb-4f2f-8aca-3ed956a70130 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:50.778897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1163/2331] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:50:50 2022] PUT /identity/v3/projects/23568023763549669484e71430e34389/users/b47d51863b0448b880dc03b01dec6dc5/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:50.783890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8308-8103-44d8-adc6-486f71f0d5e3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:50.784183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8308-8103-44d8-adc6-486f71f0d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:50.784460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a8308-8103-44d8-adc6-486f71f0d5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:50.802887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fb4a8308-8103-44d8-adc6-486f71f0d5e3 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:50.804661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fb4a8308-8103-44d8-adc6-486f71f0d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:50.871392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1169/2332] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:50.881059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490df8c6-5aeb-4f2f-8aca-3ed956a70130 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:50.882971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-490df8c6-5aeb-4f2f-8aca-3ed956a70130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:50.945615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490df8c6-5aeb-4f2f-8aca-3ed956a70130 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:50.949602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeed0e2-f900-491b-a5bc-97b5afec3c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:50.950592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed0e2-f900-491b-a5bc-97b5afec3c95 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:50.951029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed0e2-f900-491b-a5bc-97b5afec3c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:50.951396 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed0e2-f900-491b-a5bc-97b5afec3c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:50.962257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeed0e2-f900-491b-a5bc-97b5afec3c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:50.964658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeed0e2-f900-491b-a5bc-97b5afec3c95 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:50.976845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1164/2333] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:57.125891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc01428-0601-4b7e-937d-81150f8f1538 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:57.126787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc01428-0601-4b7e-937d-81150f8f1538 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:57.127073 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc01428-0601-4b7e-937d-81150f8f1538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:57.159194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1dc01428-0601-4b7e-937d-81150f8f1538 None None] MFA Rules not processed for user `b47d51863b0448b880dc03b01dec6dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:57.160571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1dc01428-0601-4b7e-937d-81150f8f1538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:57.181181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:57.243662 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1170/2334] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:50:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:57.247858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeed0e2-f900-491b-a5bc-97b5afec3c95 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:57.263999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeed0e2-f900-491b-a5bc-97b5afec3c95 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:57.270790 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b3137-41ee-49dc-ba4e-4dcca5d2647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:57.271557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b3137-41ee-49dc-ba4e-4dcca5d2647a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:57.271941 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b3137-41ee-49dc-ba4e-4dcca5d2647a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:57.272319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b3137-41ee-49dc-ba4e-4dcca5d2647a admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:57.273821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b3137-41ee-49dc-ba4e-4dcca5d2647a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:57.284999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b3137-41ee-49dc-ba4e-4dcca5d2647a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:57.469729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1165/2335] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:50:57 2022] POST /identity/v3/projects => generated 379 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:50:57.473958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc01428-0601-4b7e-937d-81150f8f1538 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:57.491691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc01428-0601-4b7e-937d-81150f8f1538 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:57.562286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f81ef-34ef-4b79-b4ba-d314ffd1d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:57.563119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f81ef-34ef-4b79-b4ba-d314ffd1d45f admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:57.563472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f81ef-34ef-4b79-b4ba-d314ffd1d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:57.563755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f81ef-34ef-4b79-b4ba-d314ffd1d45f admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:57.564465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f81ef-34ef-4b79-b4ba-d314ffd1d45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:57.566467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f81ef-34ef-4b79-b4ba-d314ffd1d45f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:57.707583 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b3137-41ee-49dc-ba4e-4dcca5d2647a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:57.708342 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1171/2336] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:50:57 2022] POST /identity/v3/users => generated 296 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:57.719567 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b3137-41ee-49dc-ba4e-4dcca5d2647a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:57.725163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3595903-5e89-46b3-8ee8-1300b51cf74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:57.725897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3595903-5e89-46b3-8ee8-1300b51cf74a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:57.726176 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3595903-5e89-46b3-8ee8-1300b51cf74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:57.726608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3595903-5e89-46b3-8ee8-1300b51cf74a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:57.727496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3595903-5e89-46b3-8ee8-1300b51cf74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:57.729285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3595903-5e89-46b3-8ee8-1300b51cf74a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:57.740568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1166/2337] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:50:57.745453 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f81ef-34ef-4b79-b4ba-d314ffd1d45f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:57.756187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f81ef-34ef-4b79-b4ba-d314ffd1d45f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:57.761360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70632440-193d-4314-b4fa-70f424104e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:57.762442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70632440-193d-4314-b4fa-70f424104e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:57.762655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70632440-193d-4314-b4fa-70f424104e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:57.762938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70632440-193d-4314-b4fa-70f424104e45 admin admin] PATH_INFO: `/v3/projects/398a9c6b7f384627a1a2397d3d487c23/users/dcc7cf39a8144d97b77a0f2166a0e28a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:57.779607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70632440-193d-4314-b4fa-70f424104e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398a9c6b7f384627a1a2397d3d487c23, user_id=dcc7cf39a8144d97b77a0f2166a0e28a, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:57.783411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70632440-193d-4314-b4fa-70f424104e45 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:57.880987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1172/2338] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:50:57 2022] PUT /identity/v3/projects/398a9c6b7f384627a1a2397d3d487c23/users/dcc7cf39a8144d97b77a0f2166a0e28a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:57.886497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3595903-5e89-46b3-8ee8-1300b51cf74a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:57.896244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3595903-5e89-46b3-8ee8-1300b51cf74a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:57.974863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb914c-1930-40e5-b032-a88938feb9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:57.976530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb914c-1930-40e5-b032-a88938feb9fe admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:57.977196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb914c-1930-40e5-b032-a88938feb9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:57.977910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb914c-1930-40e5-b032-a88938feb9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:57.979171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb914c-1930-40e5-b032-a88938feb9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:57.980830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bb914c-1930-40e5-b032-a88938feb9fe admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:57.994838 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1167/2339] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:57.998923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70632440-193d-4314-b4fa-70f424104e45 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:58.009841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70632440-193d-4314-b4fa-70f424104e45 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:58.014653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a1fb6-8305-463b-a95c-eba681187167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:58.015604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a1fb6-8305-463b-a95c-eba681187167 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:58.015937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a1fb6-8305-463b-a95c-eba681187167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:58.016211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a1fb6-8305-463b-a95c-eba681187167 admin admin] PATH_INFO: `/v3/projects/398a9c6b7f384627a1a2397d3d487c23/users/dcc7cf39a8144d97b77a0f2166a0e28a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:58.018262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a1fb6-8305-463b-a95c-eba681187167 admin admin] RBAC: Authorizing `identity:create_grant(project_id=398a9c6b7f384627a1a2397d3d487c23, user_id=dcc7cf39a8144d97b77a0f2166a0e28a, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:58.020917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a1fb6-8305-463b-a95c-eba681187167 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:58.035086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1173/2340] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:50:57 2022] PUT /identity/v3/projects/398a9c6b7f384627a1a2397d3d487c23/users/dcc7cf39a8144d97b77a0f2166a0e28a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:51:04.083264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb914c-1930-40e5-b032-a88938feb9fe admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:04.085094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-12bb914c-1930-40e5-b032-a88938feb9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:04.128315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:04.152883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bb914c-1930-40e5-b032-a88938feb9fe admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:04.214730 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1855d06-5e13-4715-8244-10d4f98bb1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:04.215621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1855d06-5e13-4715-8244-10d4f98bb1ae service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:04.215914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1855d06-5e13-4715-8244-10d4f98bb1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:04.216189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1855d06-5e13-4715-8244-10d4f98bb1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:04.220073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e1855d06-5e13-4715-8244-10d4f98bb1ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:04.309086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1855d06-5e13-4715-8244-10d4f98bb1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:04.310938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1855d06-5e13-4715-8244-10d4f98bb1ae service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:04.330073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1168/2341] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:04.667920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbf021-02e1-4e39-96cf-59f8ab4d930b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:04.671625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbf021-02e1-4e39-96cf-59f8ab4d930b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:04.671625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbf021-02e1-4e39-96cf-59f8ab4d930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:04.709304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-5bdbf021-02e1-4e39-96cf-59f8ab4d930b None None] MFA Rules not processed for user `dcc7cf39a8144d97b77a0f2166a0e28a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:04.710753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5bdbf021-02e1-4e39-96cf-59f8ab4d930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:04.791339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:04.801024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1174/2342] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:51:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:04.817102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1855d06-5e13-4715-8244-10d4f98bb1ae service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:04.819433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e1855d06-5e13-4715-8244-10d4f98bb1ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:04.837118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1855d06-5e13-4715-8244-10d4f98bb1ae service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:04.857769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ddeb1-0395-4dcf-827d-5b53ad2a4c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:04.857769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ddeb1-0395-4dcf-827d-5b53ad2a4c7c service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:04.860685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ddeb1-0395-4dcf-827d-5b53ad2a4c7c service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:04.860685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ddeb1-0395-4dcf-827d-5b53ad2a4c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:04.971910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ddeb1-0395-4dcf-827d-5b53ad2a4c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:04.975163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ddeb1-0395-4dcf-827d-5b53ad2a4c7c service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:04.989733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1169/2343] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:14.896079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:14.983189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:16.944544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbf021-02e1-4e39-96cf-59f8ab4d930b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:16.946305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-5bdbf021-02e1-4e39-96cf-59f8ab4d930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:17.020227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbf021-02e1-4e39-96cf-59f8ab4d930b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:17.025345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25baa426-99c3-42ad-a152-0b79be271b4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:17.026028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baa426-99c3-42ad-a152-0b79be271b4a service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:17.026318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baa426-99c3-42ad-a152-0b79be271b4a service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:17.026650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25baa426-99c3-42ad-a152-0b79be271b4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:17.028440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-25baa426-99c3-42ad-a152-0b79be271b4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:17.039984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25baa426-99c3-42ad-a152-0b79be271b4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:17.041654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25baa426-99c3-42ad-a152-0b79be271b4a service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:17.053516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1175/2344] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:17.103162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ddeb1-0395-4dcf-827d-5b53ad2a4c7c service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:17.104707 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-dd6ddeb1-0395-4dcf-827d-5b53ad2a4c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:17.176421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ddeb1-0395-4dcf-827d-5b53ad2a4c7c service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:17.181789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:17.182667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:17.182957 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:17.183246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] PATH_INFO: `/v3/users/646a9abb1f9d4a1295a04defd895ff7c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:17.184464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=646a9abb1f9d4a1295a04defd895ff7c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:17.186432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:17.488170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '646a9abb1f9d4a1295a04defd895ff7c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:17.559557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '646a9abb1f9d4a1295a04defd895ff7c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:17.560202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '646a9abb1f9d4a1295a04defd895ff7c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:17.560845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '646a9abb1f9d4a1295a04defd895ff7c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:17.574011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-5a44d0d0-4a2b-48f5-9e34-8608fac4be96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '646a9abb1f9d4a1295a04defd895ff7c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:17.587199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1170/2345] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:51:17 2022] DELETE /identity/v3/users/646a9abb1f9d4a1295a04defd895ff7c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:51:17.864451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25baa426-99c3-42ad-a152-0b79be271b4a service placement] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:17.875482 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25baa426-99c3-42ad-a152-0b79be271b4a service placement] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:17.935349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:17.936214 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:17.936498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:17.939648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] PATH_INFO: `/v3/projects/d539dfec943a44eb9b025d842a1f858d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:17.939648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d539dfec943a44eb9b025d842a1f858d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:17.939924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:18.068271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd539dfec943a44eb9b025d842a1f858d', 'request_id': 'req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:18.074555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd539dfec943a44eb9b025d842a1f858d', 'request_id': 'req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:18.081842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd539dfec943a44eb9b025d842a1f858d', 'request_id': 'req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:18.187136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] The token cache is being invalidate because project d539dfec943a44eb9b025d842a1f858d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:51:18.187360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:18.187956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65e9da48-ee2e-4a3d-af5d-bc9aef728dfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:18.189492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1176/2346] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:51:17 2022] DELETE /identity/v3/projects/d539dfec943a44eb9b025d842a1f858d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:51:18.194454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cecdf-1e32-40cc-a159-d198789d5b0e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:18.195058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cecdf-1e32-40cc-a159-d198789d5b0e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:18.195058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cecdf-1e32-40cc-a159-d198789d5b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:18.215921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-393cecdf-1e32-40cc-a159-d198789d5b0e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:18.217152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-393cecdf-1e32-40cc-a159-d198789d5b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:18.279383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1171/2347] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:18.287012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d591-8bd6-4f34-950f-734c59f3e31b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:18.287301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d591-8bd6-4f34-950f-734c59f3e31b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:18.287588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d591-8bd6-4f34-950f-734c59f3e31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:18.306318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7c71d591-8bd6-4f34-950f-734c59f3e31b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:18.307564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7c71d591-8bd6-4f34-950f-734c59f3e31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:18.315636 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1177/2348] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:18.319902 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cecdf-1e32-40cc-a159-d198789d5b0e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:18.330591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cecdf-1e32-40cc-a159-d198789d5b0e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:18.335280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f84a4-e8b6-46ed-a999-89efcfeb5658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:18.335944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f84a4-e8b6-46ed-a999-89efcfeb5658 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:18.336232 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f84a4-e8b6-46ed-a999-89efcfeb5658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:18.336514 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f84a4-e8b6-46ed-a999-89efcfeb5658 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:18.337950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f84a4-e8b6-46ed-a999-89efcfeb5658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:51:18.338265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f84a4-e8b6-46ed-a999-89efcfeb5658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:18.339865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f84a4-e8b6-46ed-a999-89efcfeb5658 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:18.351968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1172/2349] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:51:18.356392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d591-8bd6-4f34-950f-734c59f3e31b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:18.367356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d591-8bd6-4f34-950f-734c59f3e31b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:18.372135 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71348331-3bba-4ec5-8f03-1de3dc6193d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:18.372800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71348331-3bba-4ec5-8f03-1de3dc6193d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:18.373082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71348331-3bba-4ec5-8f03-1de3dc6193d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:18.373355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71348331-3bba-4ec5-8f03-1de3dc6193d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:18.374083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71348331-3bba-4ec5-8f03-1de3dc6193d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:18.376012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71348331-3bba-4ec5-8f03-1de3dc6193d2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:18.387055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:18.486443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1178/2350] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:51:18 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:51:18.496214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f84a4-e8b6-46ed-a999-89efcfeb5658 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:18.506368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f84a4-e8b6-46ed-a999-89efcfeb5658 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:18.510696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:18.564323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fec27-9f45-44a4-be66-28c1d5539b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:18.565000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fec27-9f45-44a4-be66-28c1d5539b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:18.565318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fec27-9f45-44a4-be66-28c1d5539b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:18.565601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2fec27-9f45-44a4-be66-28c1d5539b5b admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:18.566325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fec27-9f45-44a4-be66-28c1d5539b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:18.568265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2fec27-9f45-44a4-be66-28c1d5539b5b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:18.698173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1173/2351] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:51:18 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:51:18.702440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71348331-3bba-4ec5-8f03-1de3dc6193d2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:18.712851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71348331-3bba-4ec5-8f03-1de3dc6193d2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:18.717459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c4bae-a706-49d1-b72e-e0a7d145fbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:18.718141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c4bae-a706-49d1-b72e-e0a7d145fbff admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:18.718426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c4bae-a706-49d1-b72e-e0a7d145fbff admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:18.718704 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c4bae-a706-49d1-b72e-e0a7d145fbff admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:18.719551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c4bae-a706-49d1-b72e-e0a7d145fbff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:18.721145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c4bae-a706-49d1-b72e-e0a7d145fbff admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:18.732930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1179/2352] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:51:18.736694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fec27-9f45-44a4-be66-28c1d5539b5b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:18.747366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2fec27-9f45-44a4-be66-28c1d5539b5b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:18.752076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a90f61-42bd-4d65-b5f1-2b53583c8365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:18.752729 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a90f61-42bd-4d65-b5f1-2b53583c8365 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:18.753012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a90f61-42bd-4d65-b5f1-2b53583c8365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:18.753287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a90f61-42bd-4d65-b5f1-2b53583c8365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:18.754040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a90f61-42bd-4d65-b5f1-2b53583c8365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:18.755610 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a90f61-42bd-4d65-b5f1-2b53583c8365 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:18.766126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1174/2353] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:51:18.770990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c4bae-a706-49d1-b72e-e0a7d145fbff admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:18.781546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c4bae-a706-49d1-b72e-e0a7d145fbff admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:18.786184 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfbca7-5c88-4ce4-8751-bc9036ac8992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:18.787063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfbca7-5c88-4ce4-8751-bc9036ac8992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:18.787348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfbca7-5c88-4ce4-8751-bc9036ac8992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:18.787657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debfbca7-5c88-4ce4-8751-bc9036ac8992 admin admin] PATH_INFO: `/v3/projects/4ad4bf12bb5a4de8a7743e5d8a542093/users/c97b97bef11c4d8e949ed92755c57819/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:18.804183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfbca7-5c88-4ce4-8751-bc9036ac8992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad4bf12bb5a4de8a7743e5d8a542093, user_id=c97b97bef11c4d8e949ed92755c57819, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:18.807536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debfbca7-5c88-4ce4-8751-bc9036ac8992 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:18.885308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1180/2354] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:51:18 2022] PUT /identity/v3/projects/4ad4bf12bb5a4de8a7743e5d8a542093/users/c97b97bef11c4d8e949ed92755c57819/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:51:18.897023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129544f-ba4c-48f6-ae7f-bcf1ff7d0632 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:18.897318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129544f-ba4c-48f6-ae7f-bcf1ff7d0632 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:18.897648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129544f-ba4c-48f6-ae7f-bcf1ff7d0632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:18.926439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4129544f-ba4c-48f6-ae7f-bcf1ff7d0632 None None] MFA Rules not processed for user `c97b97bef11c4d8e949ed92755c57819`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:18.927854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4129544f-ba4c-48f6-ae7f-bcf1ff7d0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:18.994518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1175/2355] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:51:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:19.005246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfbca7-5c88-4ce4-8751-bc9036ac8992 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:19.006960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-debfbca7-5c88-4ce4-8751-bc9036ac8992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:19.065835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debfbca7-5c88-4ce4-8751-bc9036ac8992 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:19.069513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cd1e3-8fc9-4323-96f3-d97dcd964107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:19.070201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd1e3-8fc9-4323-96f3-d97dcd964107 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:19.070487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd1e3-8fc9-4323-96f3-d97dcd964107 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:19.070796 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd1e3-8fc9-4323-96f3-d97dcd964107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:19.079611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3cd1e3-8fc9-4323-96f3-d97dcd964107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:19.085026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3cd1e3-8fc9-4323-96f3-d97dcd964107 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:19.090550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1181/2356] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:25.359810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129544f-ba4c-48f6-ae7f-bcf1ff7d0632 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:25.361247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4129544f-ba4c-48f6-ae7f-bcf1ff7d0632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:25.373864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129544f-ba4c-48f6-ae7f-bcf1ff7d0632 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:25.377461 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606a0e0-c162-44fa-898c-73472545cc26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:25.380245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606a0e0-c162-44fa-898c-73472545cc26 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:25.380245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606a0e0-c162-44fa-898c-73472545cc26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:25.380245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606a0e0-c162-44fa-898c-73472545cc26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:25.380532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1606a0e0-c162-44fa-898c-73472545cc26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:25.441683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606a0e0-c162-44fa-898c-73472545cc26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:25.443118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606a0e0-c162-44fa-898c-73472545cc26 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:25.452669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1176/2357] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:25.558379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cd1e3-8fc9-4323-96f3-d97dcd964107 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:25.567122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3cd1e3-8fc9-4323-96f3-d97dcd964107 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:25.571622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aee88-48be-42f4-8bcc-dd2bc07a0953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:25.573293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aee88-48be-42f4-8bcc-dd2bc07a0953 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:25.573293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aee88-48be-42f4-8bcc-dd2bc07a0953 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:25.573293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1aee88-48be-42f4-8bcc-dd2bc07a0953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:25.575097 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1b1aee88-48be-42f4-8bcc-dd2bc07a0953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:25.649569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1aee88-48be-42f4-8bcc-dd2bc07a0953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:25.651338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1aee88-48be-42f4-8bcc-dd2bc07a0953 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:25.662845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1182/2358] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:35.263226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceb86a-0794-4688-8153-00bf8ecf173d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:35.263702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceb86a-0794-4688-8153-00bf8ecf173d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:35.263798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ceb86a-0794-4688-8153-00bf8ecf173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:35.283392 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-87ceb86a-0794-4688-8153-00bf8ecf173d None None] MFA Rules not processed for user `b47d51863b0448b880dc03b01dec6dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:35.286395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-87ceb86a-0794-4688-8153-00bf8ecf173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:35.300268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:35.352651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1177/2359] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:51:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:35.657514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=78,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:36.592736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aee88-48be-42f4-8bcc-dd2bc07a0953 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:36.594422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1b1aee88-48be-42f4-8bcc-dd2bc07a0953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:36.679411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1aee88-48be-42f4-8bcc-dd2bc07a0953 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:36.684985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f13b1-57a3-4cfd-a552-7226e94d4f0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:36.685634 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f13b1-57a3-4cfd-a552-7226e94d4f0c service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:36.685977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f13b1-57a3-4cfd-a552-7226e94d4f0c service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:36.686262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f13b1-57a3-4cfd-a552-7226e94d4f0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:36.688072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-368f13b1-57a3-4cfd-a552-7226e94d4f0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:36.700221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f13b1-57a3-4cfd-a552-7226e94d4f0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:36.701861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f13b1-57a3-4cfd-a552-7226e94d4f0c service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:36.714393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1183/2360] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:38.863992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceb86a-0794-4688-8153-00bf8ecf173d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:38.865559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-87ceb86a-0794-4688-8153-00bf8ecf173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:38.895783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ceb86a-0794-4688-8153-00bf8ecf173d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:38.905121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afb43f-3f7d-4c7f-a66c-3d04b32a9729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:38.906074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afb43f-3f7d-4c7f-a66c-3d04b32a9729 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:38.914959 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afb43f-3f7d-4c7f-a66c-3d04b32a9729 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:38.916353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afb43f-3f7d-4c7f-a66c-3d04b32a9729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:38.923199 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-93afb43f-3f7d-4c7f-a66c-3d04b32a9729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:38.950480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afb43f-3f7d-4c7f-a66c-3d04b32a9729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:38.952291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afb43f-3f7d-4c7f-a66c-3d04b32a9729 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:38.970052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1178/2361] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:40.247398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f13b1-57a3-4cfd-a552-7226e94d4f0c service placement] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:40.327572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f13b1-57a3-4cfd-a552-7226e94d4f0c service placement] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:40.332207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:40.334200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:40.334200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:40.334200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] PATH_INFO: `/v3/users/c97b97bef11c4d8e949ed92755c57819` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:40.334965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c97b97bef11c4d8e949ed92755c57819)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:40.336955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:40.424420 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afb43f-3f7d-4c7f-a66c-3d04b32a9729 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:40.425986 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-93afb43f-3f7d-4c7f-a66c-3d04b32a9729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:40.486384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afb43f-3f7d-4c7f-a66c-3d04b32a9729 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:40.490044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0ab39-1750-4bf8-b217-d1907bb12b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:40.490700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0ab39-1750-4bf8-b217-d1907bb12b6c service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:40.490985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0ab39-1750-4bf8-b217-d1907bb12b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:40.491267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0ab39-1750-4bf8-b217-d1907bb12b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:40.493022 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fed0ab39-1750-4bf8-b217-d1907bb12b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:40.503276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0ab39-1750-4bf8-b217-d1907bb12b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:40.504689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0ab39-1750-4bf8-b217-d1907bb12b6c service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:40.512621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1179/2362] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:51:40.541278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c97b97bef11c4d8e949ed92755c57819'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:40.542640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c97b97bef11c4d8e949ed92755c57819'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:40.643895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c97b97bef11c4d8e949ed92755c57819'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:40.644569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c97b97bef11c4d8e949ed92755c57819'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:40.663148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c97b97bef11c4d8e949ed92755c57819'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:40.677379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1184/2363] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:51:40 2022] DELETE /identity/v3/users/c97b97bef11c4d8e949ed92755c57819 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:51:40.682032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7f95-f060-4687-91da-02290705c14c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:40.682428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7f95-f060-4687-91da-02290705c14c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:40.687947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e7f95-f060-4687-91da-02290705c14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:40.700646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fd7e7f95-f060-4687-91da-02290705c14c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:40.701811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fd7e7f95-f060-4687-91da-02290705c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:40.765158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1180/2364] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:51:40.774767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:40.776518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:40.788742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:40.835415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d3eff-6d5e-4cdb-8d4c-54792e690552 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:40.839876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b3748-61e3-423d-aa32-41014256c190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:40.840737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3748-61e3-423d-aa32-41014256c190 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:40.841083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3748-61e3-423d-aa32-41014256c190 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:40.841083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b3748-61e3-423d-aa32-41014256c190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:40.851139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b3748-61e3-423d-aa32-41014256c190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:40.854141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b3748-61e3-423d-aa32-41014256c190 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:40.864056 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1185/2365] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:41.483580 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7f95-f060-4687-91da-02290705c14c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:41.485158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fd7e7f95-f060-4687-91da-02290705c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:41.502014 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e7f95-f060-4687-91da-02290705c14c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:41.535905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:41.536821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:41.537106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:41.537385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] PATH_INFO: `/v3/projects/4ad4bf12bb5a4de8a7743e5d8a542093` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:41.541160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad4bf12bb5a4de8a7743e5d8a542093)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:41.545415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:41.697332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:41.702818 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad4bf12bb5a4de8a7743e5d8a542093', 'request_id': 'req-a8437a4f-0cd2-4383-9026-ea986605da1f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:41.711165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad4bf12bb5a4de8a7743e5d8a542093', 'request_id': 'req-a8437a4f-0cd2-4383-9026-ea986605da1f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:41.721915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad4bf12bb5a4de8a7743e5d8a542093', 'request_id': 'req-a8437a4f-0cd2-4383-9026-ea986605da1f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:41.797732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] The token cache is being invalidate because project 4ad4bf12bb5a4de8a7743e5d8a542093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:51:41.797968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:41.798625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:41.800403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1181/2366] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:51:41 2022] DELETE /identity/v3/projects/4ad4bf12bb5a4de8a7743e5d8a542093 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:51:42.484507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b3748-61e3-423d-aa32-41014256c190 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:42.485956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ec6b3748-61e3-423d-aa32-41014256c190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:42.569342 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b3748-61e3-423d-aa32-41014256c190 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:42.633167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb5b69-351c-4498-91a0-2d80ad0b984d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:42.633862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb5b69-351c-4498-91a0-2d80ad0b984d service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:42.634132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb5b69-351c-4498-91a0-2d80ad0b984d service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:42.634412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb5b69-351c-4498-91a0-2d80ad0b984d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:42.636165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9dbb5b69-351c-4498-91a0-2d80ad0b984d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:42.681519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:42.693549 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb5b69-351c-4498-91a0-2d80ad0b984d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:42.695195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb5b69-351c-4498-91a0-2d80ad0b984d service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:42.704918 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1186/2367] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:51.893230 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:51.894983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:51.911407 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8437a4f-0cd2-4383-9026-ea986605da1f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:51.916841 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6433e7-cfe9-4c3e-87ee-d6e840c8c086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:51.922655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6433e7-cfe9-4c3e-87ee-d6e840c8c086 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:51.922655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6433e7-cfe9-4c3e-87ee-d6e840c8c086 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:51.922655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6433e7-cfe9-4c3e-87ee-d6e840c8c086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:51.922655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0f6433e7-cfe9-4c3e-87ee-d6e840c8c086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:51.931912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6433e7-cfe9-4c3e-87ee-d6e840c8c086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:51.933501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6433e7-cfe9-4c3e-87ee-d6e840c8c086 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:51.944667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1182/2368] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:52.713136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:54.705247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb5b69-351c-4498-91a0-2d80ad0b984d service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:54.717337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb5b69-351c-4498-91a0-2d80ad0b984d service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:54.723093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be96d7f-a286-4b2a-b89b-c7a34940c359 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:54.723739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be96d7f-a286-4b2a-b89b-c7a34940c359 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:54.724030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be96d7f-a286-4b2a-b89b-c7a34940c359 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:54.724303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be96d7f-a286-4b2a-b89b-c7a34940c359 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:54.726139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1be96d7f-a286-4b2a-b89b-c7a34940c359 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:54.786860 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be96d7f-a286-4b2a-b89b-c7a34940c359 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:54.788387 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be96d7f-a286-4b2a-b89b-c7a34940c359 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:54.799607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1187/2369] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:56.330195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6433e7-cfe9-4c3e-87ee-d6e840c8c086 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:56.334862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0f6433e7-cfe9-4c3e-87ee-d6e840c8c086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:56.399747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6433e7-cfe9-4c3e-87ee-d6e840c8c086 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:56.404192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7ab24-c368-4bc7-a45d-44ac87b111d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:56.404861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7ab24-c368-4bc7-a45d-44ac87b111d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:56.405615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7ab24-c368-4bc7-a45d-44ac87b111d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:56.405615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7ab24-c368-4bc7-a45d-44ac87b111d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:56.408124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-26f7ab24-c368-4bc7-a45d-44ac87b111d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:56.506174 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7ab24-c368-4bc7-a45d-44ac87b111d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:56.507645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7ab24-c368-4bc7-a45d-44ac87b111d2 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:56.530379 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1183/2370] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:56.736900 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be96d7f-a286-4b2a-b89b-c7a34940c359 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:56.738523 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1be96d7f-a286-4b2a-b89b-c7a34940c359 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:56.754955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be96d7f-a286-4b2a-b89b-c7a34940c359 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:56.758764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0f3eb-929d-44c8-9716-af93887deb3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:56.759419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0f3eb-929d-44c8-9716-af93887deb3f service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:56.759707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0f3eb-929d-44c8-9716-af93887deb3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:56.759989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee0f3eb-929d-44c8-9716-af93887deb3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:56.762456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-aee0f3eb-929d-44c8-9716-af93887deb3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:56.834672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0f3eb-929d-44c8-9716-af93887deb3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:56.836123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee0f3eb-929d-44c8-9716-af93887deb3f service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:56.846218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1188/2371] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:02.447953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7ab24-c368-4bc7-a45d-44ac87b111d2 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:02.450399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-26f7ab24-c368-4bc7-a45d-44ac87b111d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:02.464092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7ab24-c368-4bc7-a45d-44ac87b111d2 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:02.482849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:02.483895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:02.484285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:02.484933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] PATH_INFO: `/v3/users/cf98a4d33cab49b08640f437dbfb2dc8` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:02.487527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf98a4d33cab49b08640f437dbfb2dc8)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:02.489998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:02.883357 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf98a4d33cab49b08640f437dbfb2dc8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:02.999145 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf98a4d33cab49b08640f437dbfb2dc8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:02.999779 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf98a4d33cab49b08640f437dbfb2dc8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:03.000447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf98a4d33cab49b08640f437dbfb2dc8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:03.008246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:03.013586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c2bad9f-179c-4938-ad77-8d7c71e17ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf98a4d33cab49b08640f437dbfb2dc8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:03.029615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1184/2372] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:52:02 2022] DELETE /identity/v3/users/cf98a4d33cab49b08640f437dbfb2dc8 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:03.372040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0f3eb-929d-44c8-9716-af93887deb3f service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:03.383056 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee0f3eb-929d-44c8-9716-af93887deb3f service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:03.474124 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:03.475187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:03.475484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:03.475768 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] PATH_INFO: `/v3/projects/9930a0f4448d4ef0a6030da17a36257a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:03.477050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9930a0f4448d4ef0a6030da17a36257a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:03.478991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:03.612588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:03.622001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9930a0f4448d4ef0a6030da17a36257a', 'request_id': 'req-5ec9a121-f90b-4472-9eef-8745c60c0856'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:03.627264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9930a0f4448d4ef0a6030da17a36257a', 'request_id': 'req-5ec9a121-f90b-4472-9eef-8745c60c0856'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:03.633431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9930a0f4448d4ef0a6030da17a36257a', 'request_id': 'req-5ec9a121-f90b-4472-9eef-8745c60c0856'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:03.690087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] The token cache is being invalidate because project 9930a0f4448d4ef0a6030da17a36257a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:52:03.690381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:03.691060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5ec9a121-f90b-4472-9eef-8745c60c0856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:03.692694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1189/2373] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:52:03 2022] DELETE /identity/v3/projects/9930a0f4448d4ef0a6030da17a36257a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:03.697879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ae6d-a39f-4495-b719-c720630ee89e None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:03.702292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ae6d-a39f-4495-b719-c720630ee89e None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:03.702292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4ae6d-a39f-4495-b719-c720630ee89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:03.717073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-77f4ae6d-a39f-4495-b719-c720630ee89e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:03.718330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-77f4ae6d-a39f-4495-b719-c720630ee89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:03.777752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1185/2374] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:03.785534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480195e-f615-430e-bc00-9de50962d33e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:03.785852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480195e-f615-430e-bc00-9de50962d33e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:03.786134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480195e-f615-430e-bc00-9de50962d33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:03.806311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2480195e-f615-430e-bc00-9de50962d33e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:03.807557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2480195e-f615-430e-bc00-9de50962d33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:03.816345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1190/2375] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:03.820747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4ae6d-a39f-4495-b719-c720630ee89e None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:03.831108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4ae6d-a39f-4495-b719-c720630ee89e None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:03.835656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ac73a-53d9-40ae-ac1f-7a49d11a4f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:03.836305 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ac73a-53d9-40ae-ac1f-7a49d11a4f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:03.836591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ac73a-53d9-40ae-ac1f-7a49d11a4f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:03.836871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ac73a-53d9-40ae-ac1f-7a49d11a4f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:03.837599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ac73a-53d9-40ae-ac1f-7a49d11a4f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:52:03.837948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ac73a-53d9-40ae-ac1f-7a49d11a4f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:03.839538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ac73a-53d9-40ae-ac1f-7a49d11a4f5f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:03.851312 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1186/2376] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:52:03.855558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480195e-f615-430e-bc00-9de50962d33e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:03.864703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480195e-f615-430e-bc00-9de50962d33e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:03.869305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4185612-ce67-45f4-89fb-c92430aa010f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:03.869983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4185612-ce67-45f4-89fb-c92430aa010f admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:03.870275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4185612-ce67-45f4-89fb-c92430aa010f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:03.870552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4185612-ce67-45f4-89fb-c92430aa010f admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:03.871280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4185612-ce67-45f4-89fb-c92430aa010f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:03.873756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4185612-ce67-45f4-89fb-c92430aa010f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:04.018640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1191/2377] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:52:03 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:04.022590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ac73a-53d9-40ae-ac1f-7a49d11a4f5f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:04.034156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ac73a-53d9-40ae-ac1f-7a49d11a4f5f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:04.100385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547cf00-c89f-4170-aa83-42e8e7ca1475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:04.101059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547cf00-c89f-4170-aa83-42e8e7ca1475 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.101346 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547cf00-c89f-4170-aa83-42e8e7ca1475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.101627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547cf00-c89f-4170-aa83-42e8e7ca1475 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.102340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547cf00-c89f-4170-aa83-42e8e7ca1475 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:04.104325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547cf00-c89f-4170-aa83-42e8e7ca1475 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:04.268427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1187/2378] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:52:04 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:04.272744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4185612-ce67-45f4-89fb-c92430aa010f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:04.282937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4185612-ce67-45f4-89fb-c92430aa010f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:04.287720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab23ec-385f-4259-a30d-88785a3c5057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:04.288412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab23ec-385f-4259-a30d-88785a3c5057 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.288701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab23ec-385f-4259-a30d-88785a3c5057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.289091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab23ec-385f-4259-a30d-88785a3c5057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.289859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab23ec-385f-4259-a30d-88785a3c5057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:04.291518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab23ec-385f-4259-a30d-88785a3c5057 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:04.302381 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1192/2379] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:04.306476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547cf00-c89f-4170-aa83-42e8e7ca1475 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:04.318055 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547cf00-c89f-4170-aa83-42e8e7ca1475 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:04.323459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe10fd-b336-4586-82a9-341d640b253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:04.324128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe10fd-b336-4586-82a9-341d640b253f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.324525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe10fd-b336-4586-82a9-341d640b253f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.324806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe10fd-b336-4586-82a9-341d640b253f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.325561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe10fd-b336-4586-82a9-341d640b253f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:04.327205 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe10fd-b336-4586-82a9-341d640b253f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:04.338285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1188/2380] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:04.342588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab23ec-385f-4259-a30d-88785a3c5057 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:04.353149 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab23ec-385f-4259-a30d-88785a3c5057 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:04.358216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35857903-cda4-4475-8b53-fa680ad80598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:04.359080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35857903-cda4-4475-8b53-fa680ad80598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.359361 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35857903-cda4-4475-8b53-fa680ad80598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.359633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35857903-cda4-4475-8b53-fa680ad80598 admin admin] PATH_INFO: `/v3/projects/0c4ed1075b9248a7ba8bb7513e5b45ee/users/dab2781deb7f42ee8bfd82a3ad0d58d5/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.374633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35857903-cda4-4475-8b53-fa680ad80598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c4ed1075b9248a7ba8bb7513e5b45ee, user_id=dab2781deb7f42ee8bfd82a3ad0d58d5, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:04.377292 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35857903-cda4-4475-8b53-fa680ad80598 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:04.448988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1193/2381] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:52:04 2022] PUT /identity/v3/projects/0c4ed1075b9248a7ba8bb7513e5b45ee/users/dab2781deb7f42ee8bfd82a3ad0d58d5/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:04.462276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853289-57c4-489c-9712-f30572443911 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.462574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853289-57c4-489c-9712-f30572443911 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.462856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853289-57c4-489c-9712-f30572443911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.493326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-52853289-57c4-489c-9712-f30572443911 None None] MFA Rules not processed for user `dab2781deb7f42ee8bfd82a3ad0d58d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:04.494609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-52853289-57c4-489c-9712-f30572443911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:04.533541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:04.580877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1189/2382] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:52:04.585468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35857903-cda4-4475-8b53-fa680ad80598 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:04.649498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35857903-cda4-4475-8b53-fa680ad80598 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:04.654897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eac69-195d-41b0-a257-8d38abe5beae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:04.655565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eac69-195d-41b0-a257-8d38abe5beae admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.655853 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eac69-195d-41b0-a257-8d38abe5beae admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.656138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eac69-195d-41b0-a257-8d38abe5beae admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.656842 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eac69-195d-41b0-a257-8d38abe5beae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:04.658955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eac69-195d-41b0-a257-8d38abe5beae admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:04.735507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1194/2383] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:52:04 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:52:04.736980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52853289-57c4-489c-9712-f30572443911 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:04.748277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52853289-57c4-489c-9712-f30572443911 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:04.807371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079774d-7d3a-486f-8c27-050f96ee4d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:04.807973 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079774d-7d3a-486f-8c27-050f96ee4d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.808259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079774d-7d3a-486f-8c27-050f96ee4d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.808543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079774d-7d3a-486f-8c27-050f96ee4d0c admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.809262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079774d-7d3a-486f-8c27-050f96ee4d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:04.811218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079774d-7d3a-486f-8c27-050f96ee4d0c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:04.910370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1190/2384] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:52:04 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:04.911994 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eac69-195d-41b0-a257-8d38abe5beae admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:04.922583 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eac69-195d-41b0-a257-8d38abe5beae admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:04.927218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67ae7-96f9-4312-8478-2bd8a5198069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:04.927881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67ae7-96f9-4312-8478-2bd8a5198069 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.928169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67ae7-96f9-4312-8478-2bd8a5198069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.928447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff67ae7-96f9-4312-8478-2bd8a5198069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.929206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff67ae7-96f9-4312-8478-2bd8a5198069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:04.930843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff67ae7-96f9-4312-8478-2bd8a5198069 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:04.942285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1195/2385] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:52:04.946386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079774d-7d3a-486f-8c27-050f96ee4d0c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:04.957175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079774d-7d3a-486f-8c27-050f96ee4d0c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:04.961853 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b15a-58b3-452b-89dd-1aed2f2a801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:04.962737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b15a-58b3-452b-89dd-1aed2f2a801a admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:04.963023 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b15a-58b3-452b-89dd-1aed2f2a801a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:04.963300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b15a-58b3-452b-89dd-1aed2f2a801a admin admin] PATH_INFO: `/v3/projects/7fe000af54454d5485f3ca4a51676435/users/f875710667314e94a48eec7b4d5efc6a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:04.979895 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b15a-58b3-452b-89dd-1aed2f2a801a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe000af54454d5485f3ca4a51676435, user_id=f875710667314e94a48eec7b4d5efc6a, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:04.982586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b15a-58b3-452b-89dd-1aed2f2a801a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:05.056956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1191/2386] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:52:04 2022] PUT /identity/v3/projects/7fe000af54454d5485f3ca4a51676435/users/f875710667314e94a48eec7b4d5efc6a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:05.060558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67ae7-96f9-4312-8478-2bd8a5198069 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:05.071086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff67ae7-96f9-4312-8478-2bd8a5198069 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:05.108225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:05.133850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9edfc5-e529-4bb4-97b0-fc380fa1b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:05.134603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9edfc5-e529-4bb4-97b0-fc380fa1b1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:05.135141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9edfc5-e529-4bb4-97b0-fc380fa1b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:05.135616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9edfc5-e529-4bb4-97b0-fc380fa1b1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:05.136351 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9edfc5-e529-4bb4-97b0-fc380fa1b1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:05.138504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9edfc5-e529-4bb4-97b0-fc380fa1b1bc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:05.148868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1196/2387] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:05.153147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b15a-58b3-452b-89dd-1aed2f2a801a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:05.164393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b15a-58b3-452b-89dd-1aed2f2a801a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:05.169096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f30f-8410-4f09-89fe-2f10e6ab4ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:05.170065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f30f-8410-4f09-89fe-2f10e6ab4ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:05.170353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f30f-8410-4f09-89fe-2f10e6ab4ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:05.170628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8f30f-8410-4f09-89fe-2f10e6ab4ea4 admin admin] PATH_INFO: `/v3/projects/7fe000af54454d5485f3ca4a51676435/users/f875710667314e94a48eec7b4d5efc6a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:05.172580 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8f30f-8410-4f09-89fe-2f10e6ab4ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe000af54454d5485f3ca4a51676435, user_id=f875710667314e94a48eec7b4d5efc6a, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:05.175291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8f30f-8410-4f09-89fe-2f10e6ab4ea4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:05.187813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1192/2388] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:52:05 2022] PUT /identity/v3/projects/7fe000af54454d5485f3ca4a51676435/users/f875710667314e94a48eec7b4d5efc6a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:05.198987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb10f-a310-457d-9ab6-106f4b37a513 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:05.199286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb10f-a310-457d-9ab6-106f4b37a513 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:05.199569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb10f-a310-457d-9ab6-106f4b37a513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:05.226760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-dcecb10f-a310-457d-9ab6-106f4b37a513 None None] MFA Rules not processed for user `f875710667314e94a48eec7b4d5efc6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:05.230143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dcecb10f-a310-457d-9ab6-106f4b37a513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:05.296118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1197/2389] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:52:05.307648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f30f-8410-4f09-89fe-2f10e6ab4ea4 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:05.309318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-60d8f30f-8410-4f09-89fe-2f10e6ab4ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:05.375102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8f30f-8410-4f09-89fe-2f10e6ab4ea4 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:05.379044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355ee2f-31e6-4334-a2cc-2e7940aa2667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:05.379503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355ee2f-31e6-4334-a2cc-2e7940aa2667 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:05.379791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355ee2f-31e6-4334-a2cc-2e7940aa2667 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:05.380071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355ee2f-31e6-4334-a2cc-2e7940aa2667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:05.389992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355ee2f-31e6-4334-a2cc-2e7940aa2667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:05.391466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355ee2f-31e6-4334-a2cc-2e7940aa2667 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:05.401428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1193/2390] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:06.392183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecb10f-a310-457d-9ab6-106f4b37a513 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:06.468654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecb10f-a310-457d-9ab6-106f4b37a513 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:06.475844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:06.475844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:06.475844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:06.475844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] PATH_INFO: `/v3/users/dab2781deb7f42ee8bfd82a3ad0d58d5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:06.477022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab2781deb7f42ee8bfd82a3ad0d58d5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:06.479062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:06.669795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab2781deb7f42ee8bfd82a3ad0d58d5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:06.670454 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab2781deb7f42ee8bfd82a3ad0d58d5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:06.798791 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab2781deb7f42ee8bfd82a3ad0d58d5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:06.799435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab2781deb7f42ee8bfd82a3ad0d58d5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:06.801732 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:06.812741 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab2781deb7f42ee8bfd82a3ad0d58d5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:06.826071 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1198/2391] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:52:06 2022] DELETE /identity/v3/users/dab2781deb7f42ee8bfd82a3ad0d58d5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:06.830967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad702-9bad-4900-bcf5-89443df16b35 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:06.831497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad702-9bad-4900-bcf5-89443df16b35 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:06.831596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dad702-9bad-4900-bcf5-89443df16b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:06.851289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e3dad702-9bad-4900-bcf5-89443df16b35 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:06.852501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e3dad702-9bad-4900-bcf5-89443df16b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:06.878702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:06.912818 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1194/2392] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:06.923047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:06.924594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:06.986112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda73550-b78d-43ad-85c9-d6d593b4ab54 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:06.989775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22d014-c2c7-483a-97fb-ed0bde27b93d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:06.990427 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22d014-c2c7-483a-97fb-ed0bde27b93d service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:06.990757 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22d014-c2c7-483a-97fb-ed0bde27b93d service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:06.990985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22d014-c2c7-483a-97fb-ed0bde27b93d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:07.001049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22d014-c2c7-483a-97fb-ed0bde27b93d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:07.002549 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22d014-c2c7-483a-97fb-ed0bde27b93d service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:07.012384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1199/2393] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:52:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:07.679237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dad702-9bad-4900-bcf5-89443df16b35 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:07.680783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e3dad702-9bad-4900-bcf5-89443df16b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:07.694080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dad702-9bad-4900-bcf5-89443df16b35 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:07.699555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:07.700721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:07.701642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:07.702340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] PATH_INFO: `/v3/projects/0c4ed1075b9248a7ba8bb7513e5b45ee` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:07.704586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c4ed1075b9248a7ba8bb7513e5b45ee)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:07.706603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:07.861697 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c4ed1075b9248a7ba8bb7513e5b45ee', 'request_id': 'req-df66fdc9-4387-4361-bf04-cfec70b940f8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:07.867337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c4ed1075b9248a7ba8bb7513e5b45ee', 'request_id': 'req-df66fdc9-4387-4361-bf04-cfec70b940f8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:07.873825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c4ed1075b9248a7ba8bb7513e5b45ee', 'request_id': 'req-df66fdc9-4387-4361-bf04-cfec70b940f8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:07.939693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] The token cache is being invalidate because project 0c4ed1075b9248a7ba8bb7513e5b45ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:52:07.939987 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:07.940625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-df66fdc9-4387-4361-bf04-cfec70b940f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:07.942620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1195/2394] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:52:07 2022] DELETE /identity/v3/projects/0c4ed1075b9248a7ba8bb7513e5b45ee => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:07.946395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22d014-c2c7-483a-97fb-ed0bde27b93d service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:07.957155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22d014-c2c7-483a-97fb-ed0bde27b93d service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:08.015882 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:08.016983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:08.017268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:08.017550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] PATH_INFO: `/v3/users/f875710667314e94a48eec7b4d5efc6a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:08.019234 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f875710667314e94a48eec7b4d5efc6a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:08.023740 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:08.236836 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f875710667314e94a48eec7b4d5efc6a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:08.237546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f875710667314e94a48eec7b4d5efc6a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:08.307164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f875710667314e94a48eec7b4d5efc6a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:08.307792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f875710667314e94a48eec7b4d5efc6a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:08.321514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f875710667314e94a48eec7b4d5efc6a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:08.327850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:08.335413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1200/2395] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:52:07 2022] DELETE /identity/v3/users/f875710667314e94a48eec7b4d5efc6a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:52:08.447074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355709-9876-48d0-bd4e-a65104ca67aa None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:08.447364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355709-9876-48d0-bd4e-a65104ca67aa None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:08.447642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7355709-9876-48d0-bd4e-a65104ca67aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:08.465762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e7355709-9876-48d0-bd4e-a65104ca67aa None None] MFA Rules not processed for user `0537911b91184fcdbdcc9e93ec3fe5b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:08.466961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e7355709-9876-48d0-bd4e-a65104ca67aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:08.522962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1196/2396] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:08.927984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:08.929433 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:09.003526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a8270-bdb1-4ae2-bffa-06654afa0845 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:09.008187 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:09.009050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:09.009337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:09.009616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] PATH_INFO: `/v3/projects/7fe000af54454d5485f3ca4a51676435` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:09.010854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe000af54454d5485f3ca4a51676435)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:09.012770 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:09.121308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe000af54454d5485f3ca4a51676435', 'request_id': 'req-602462cb-3d11-4f80-8e8b-15a53af1dd45'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:09.127019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe000af54454d5485f3ca4a51676435', 'request_id': 'req-602462cb-3d11-4f80-8e8b-15a53af1dd45'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:09.133380 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe000af54454d5485f3ca4a51676435', 'request_id': 'req-602462cb-3d11-4f80-8e8b-15a53af1dd45'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:09.202093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] The token cache is being invalidate because project 7fe000af54454d5485f3ca4a51676435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:52:09.202301 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:09.202913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-602462cb-3d11-4f80-8e8b-15a53af1dd45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:09.204448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1201/2397] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:52:08 2022] DELETE /identity/v3/projects/7fe000af54454d5485f3ca4a51676435 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:09.209313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51078-2fb1-4138-94ba-5b3674bd9175 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:09.209793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51078-2fb1-4138-94ba-5b3674bd9175 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:09.209905 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e51078-2fb1-4138-94ba-5b3674bd9175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:09.228229 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-42e51078-2fb1-4138-94ba-5b3674bd9175 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:09.229409 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-42e51078-2fb1-4138-94ba-5b3674bd9175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:09.279872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:09.288815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1197/2398] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:09.297035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c943d-54be-45d2-a3c1-d36a57c75f11 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:09.297378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c943d-54be-45d2-a3c1-d36a57c75f11 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:09.297721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c943d-54be-45d2-a3c1-d36a57c75f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:09.318769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-384c943d-54be-45d2-a3c1-d36a57c75f11 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:09.319979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-384c943d-54be-45d2-a3c1-d36a57c75f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:09.329209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1202/2399] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:52:09.333410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51078-2fb1-4138-94ba-5b3674bd9175 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:09.344010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e51078-2fb1-4138-94ba-5b3674bd9175 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:09.349187 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed76ed-f463-4334-93de-52b9a007fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:09.349939 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed76ed-f463-4334-93de-52b9a007fc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:09.354994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed76ed-f463-4334-93de-52b9a007fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:09.354994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed76ed-f463-4334-93de-52b9a007fc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:09.354994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed76ed-f463-4334-93de-52b9a007fc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:52:09.354994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed76ed-f463-4334-93de-52b9a007fc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:09.354994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed76ed-f463-4334-93de-52b9a007fc57 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:09.366708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1198/2400] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:52:09.371043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c943d-54be-45d2-a3c1-d36a57c75f11 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:09.381232 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c943d-54be-45d2-a3c1-d36a57c75f11 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:09.386460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca5eff-bd68-4be5-a62a-9e551708a346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:09.387126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca5eff-bd68-4be5-a62a-9e551708a346 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:09.387412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca5eff-bd68-4be5-a62a-9e551708a346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:09.387723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca5eff-bd68-4be5-a62a-9e551708a346 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:09.388934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca5eff-bd68-4be5-a62a-9e551708a346 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:09.391085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca5eff-bd68-4be5-a62a-9e551708a346 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:09.506736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1203/2401] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:52:09 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:52:09.507938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed76ed-f463-4334-93de-52b9a007fc57 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:09.518543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed76ed-f463-4334-93de-52b9a007fc57 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:09.582497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655c7a3-bced-4bc5-8441-0515b2013717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:09.583180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655c7a3-bced-4bc5-8441-0515b2013717 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:09.583462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655c7a3-bced-4bc5-8441-0515b2013717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:09.583736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655c7a3-bced-4bc5-8441-0515b2013717 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:09.584422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655c7a3-bced-4bc5-8441-0515b2013717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:09.586657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655c7a3-bced-4bc5-8441-0515b2013717 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:09.693010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1199/2402] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:52:09 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:09.695182 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca5eff-bd68-4be5-a62a-9e551708a346 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:09.706582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca5eff-bd68-4be5-a62a-9e551708a346 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:09.711635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01f2fe-7620-42bc-a7ca-3e3d3e1c415f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:09.712416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f2fe-7620-42bc-a7ca-3e3d3e1c415f admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:09.712711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f2fe-7620-42bc-a7ca-3e3d3e1c415f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:09.712988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01f2fe-7620-42bc-a7ca-3e3d3e1c415f admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:09.713744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01f2fe-7620-42bc-a7ca-3e3d3e1c415f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:09.715356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01f2fe-7620-42bc-a7ca-3e3d3e1c415f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:09.725678 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1204/2403] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:09.729717 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655c7a3-bced-4bc5-8441-0515b2013717 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:09.739858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655c7a3-bced-4bc5-8441-0515b2013717 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:09.744852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f360119-c73b-47be-9e39-3722e7b5285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:09.745504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360119-c73b-47be-9e39-3722e7b5285a admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:09.745830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360119-c73b-47be-9e39-3722e7b5285a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:09.746155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f360119-c73b-47be-9e39-3722e7b5285a admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:09.746872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f360119-c73b-47be-9e39-3722e7b5285a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:09.748961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f360119-c73b-47be-9e39-3722e7b5285a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:09.759309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1200/2404] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:09.763532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01f2fe-7620-42bc-a7ca-3e3d3e1c415f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:09.774024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01f2fe-7620-42bc-a7ca-3e3d3e1c415f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:09.778647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25649bec-2c59-481d-ab61-ba464d88bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:09.779549 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25649bec-2c59-481d-ab61-ba464d88bcfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:09.779836 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25649bec-2c59-481d-ab61-ba464d88bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:09.780118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25649bec-2c59-481d-ab61-ba464d88bcfd admin admin] PATH_INFO: `/v3/projects/feb3d2ad85244b7f89f1ea27fa985d7b/users/2686c2be9db7474ab58aac1bba00f6b2/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:09.794632 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25649bec-2c59-481d-ab61-ba464d88bcfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=feb3d2ad85244b7f89f1ea27fa985d7b, user_id=2686c2be9db7474ab58aac1bba00f6b2, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:09.797304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25649bec-2c59-481d-ab61-ba464d88bcfd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:09.907694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1205/2405] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:52:09 2022] PUT /identity/v3/projects/feb3d2ad85244b7f89f1ea27fa985d7b/users/2686c2be9db7474ab58aac1bba00f6b2/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:09.919700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7710749-7f8c-4cfb-a110-c425d89dd378 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:09.919996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7710749-7f8c-4cfb-a110-c425d89dd378 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:09.920280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7710749-7f8c-4cfb-a110-c425d89dd378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:09.947606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e7710749-7f8c-4cfb-a110-c425d89dd378 None None] MFA Rules not processed for user `2686c2be9db7474ab58aac1bba00f6b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:09.948823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e7710749-7f8c-4cfb-a110-c425d89dd378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:10.012516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1201/2406] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:10.017539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25649bec-2c59-481d-ab61-ba464d88bcfd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:10.030977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:10.084138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25649bec-2c59-481d-ab61-ba464d88bcfd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:10.088862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e838e-342e-4e75-8e68-7c04faba6481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:10.089532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e838e-342e-4e75-8e68-7c04faba6481 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:10.089859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e838e-342e-4e75-8e68-7c04faba6481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:10.090146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e838e-342e-4e75-8e68-7c04faba6481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:10.090894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e838e-342e-4e75-8e68-7c04faba6481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:10.092811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e838e-342e-4e75-8e68-7c04faba6481 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:10.270203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1206/2407] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:52:10 2022] POST /identity/v3/projects => generated 385 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:10.271262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7710749-7f8c-4cfb-a110-c425d89dd378 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:10.284421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7710749-7f8c-4cfb-a110-c425d89dd378 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:10.335329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:10.342240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f0857-abff-4f7b-8ab9-8602dc7b6f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:10.345220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f0857-abff-4f7b-8ab9-8602dc7b6f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:10.345220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f0857-abff-4f7b-8ab9-8602dc7b6f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:10.345220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1f0857-abff-4f7b-8ab9-8602dc7b6f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:10.345220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f0857-abff-4f7b-8ab9-8602dc7b6f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:10.346170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1f0857-abff-4f7b-8ab9-8602dc7b6f7a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:10.476132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1202/2408] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:52:10 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:10.478513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e838e-342e-4e75-8e68-7c04faba6481 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:10.490183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e838e-342e-4e75-8e68-7c04faba6481 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:10.494874 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7550-1cdd-4a6e-8872-a95ad04c58aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:10.499001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7550-1cdd-4a6e-8872-a95ad04c58aa admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:10.499001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7550-1cdd-4a6e-8872-a95ad04c58aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:10.499001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d7550-1cdd-4a6e-8872-a95ad04c58aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:10.499001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7550-1cdd-4a6e-8872-a95ad04c58aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:10.499001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d7550-1cdd-4a6e-8872-a95ad04c58aa admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:10.509524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1207/2409] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:10.514168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f0857-abff-4f7b-8ab9-8602dc7b6f7a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:10.527565 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1f0857-abff-4f7b-8ab9-8602dc7b6f7a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:10.528911 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17634218-f1f9-4e23-8693-d36e2f865b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:10.530456 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17634218-f1f9-4e23-8693-d36e2f865b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:10.530735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17634218-f1f9-4e23-8693-d36e2f865b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:10.531010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17634218-f1f9-4e23-8693-d36e2f865b46 admin admin] PATH_INFO: `/v3/projects/9ab1e31a6a1d4f1f8ee00c23db3720e0/users/ad1d861f9a0f4cf5a0b06d0fc5c88c08/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:10.547653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17634218-f1f9-4e23-8693-d36e2f865b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab1e31a6a1d4f1f8ee00c23db3720e0, user_id=ad1d861f9a0f4cf5a0b06d0fc5c88c08, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:10.550805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17634218-f1f9-4e23-8693-d36e2f865b46 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:10.629207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1203/2410] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:52:10 2022] PUT /identity/v3/projects/9ab1e31a6a1d4f1f8ee00c23db3720e0/users/ad1d861f9a0f4cf5a0b06d0fc5c88c08/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:10.633443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7550-1cdd-4a6e-8872-a95ad04c58aa admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:10.644638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d7550-1cdd-4a6e-8872-a95ad04c58aa admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:10.713259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b44d5-0fca-494d-a001-b14a259a4752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:10.713978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b44d5-0fca-494d-a001-b14a259a4752 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:10.714268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b44d5-0fca-494d-a001-b14a259a4752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:10.714547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b44d5-0fca-494d-a001-b14a259a4752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:10.715279 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b44d5-0fca-494d-a001-b14a259a4752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:10.717507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b44d5-0fca-494d-a001-b14a259a4752 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:10.730337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1208/2411] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:10.734646 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17634218-f1f9-4e23-8693-d36e2f865b46 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:10.745563 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17634218-f1f9-4e23-8693-d36e2f865b46 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:10.750771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc6216-ea54-4308-bf5a-e8e2eb62fb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:10.752500 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc6216-ea54-4308-bf5a-e8e2eb62fb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:10.752500 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc6216-ea54-4308-bf5a-e8e2eb62fb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:10.752500 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc6216-ea54-4308-bf5a-e8e2eb62fb42 admin admin] PATH_INFO: `/v3/projects/9ab1e31a6a1d4f1f8ee00c23db3720e0/users/ad1d861f9a0f4cf5a0b06d0fc5c88c08/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:10.754653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc6216-ea54-4308-bf5a-e8e2eb62fb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab1e31a6a1d4f1f8ee00c23db3720e0, user_id=ad1d861f9a0f4cf5a0b06d0fc5c88c08, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:10.757534 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc6216-ea54-4308-bf5a-e8e2eb62fb42 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:10.772135 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1204/2412] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:52:10 2022] PUT /identity/v3/projects/9ab1e31a6a1d4f1f8ee00c23db3720e0/users/ad1d861f9a0f4cf5a0b06d0fc5c88c08/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:10.786399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32af9-6bf2-425b-8690-f2664e516fd4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:10.786399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32af9-6bf2-425b-8690-f2664e516fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:10.786399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a32af9-6bf2-425b-8690-f2664e516fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:10.816761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-67a32af9-6bf2-425b-8690-f2664e516fd4 None None] MFA Rules not processed for user `ad1d861f9a0f4cf5a0b06d0fc5c88c08`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:10.818298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-67a32af9-6bf2-425b-8690-f2664e516fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:10.896465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1209/2413] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:10.908370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc6216-ea54-4308-bf5a-e8e2eb62fb42 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:10.910104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fbfc6216-ea54-4308-bf5a-e8e2eb62fb42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:10.971481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc6216-ea54-4308-bf5a-e8e2eb62fb42 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:10.975833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600b717-33f0-4b24-87a6-d10449bf50e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:10.976584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b717-33f0-4b24-87a6-d10449bf50e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:10.976950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b717-33f0-4b24-87a6-d10449bf50e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:10.977271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600b717-33f0-4b24-87a6-d10449bf50e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:10.987731 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600b717-33f0-4b24-87a6-d10449bf50e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:10.989159 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600b717-33f0-4b24-87a6-d10449bf50e8 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:10.998811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1205/2414] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:52:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:11.026662 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a32af9-6bf2-425b-8690-f2664e516fd4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:11.037484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:11.093199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a32af9-6bf2-425b-8690-f2664e516fd4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:11.098152 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:11.099030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:11.099316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:11.099594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] PATH_INFO: `/v3/users/2686c2be9db7474ab58aac1bba00f6b2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:11.100802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2686c2be9db7474ab58aac1bba00f6b2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:11.102772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:11.357109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2686c2be9db7474ab58aac1bba00f6b2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:11.357807 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2686c2be9db7474ab58aac1bba00f6b2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:11.422039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2686c2be9db7474ab58aac1bba00f6b2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:11.422909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2686c2be9db7474ab58aac1bba00f6b2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:11.438271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2686c2be9db7474ab58aac1bba00f6b2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:11.452579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1210/2415] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:52:11 2022] DELETE /identity/v3/users/2686c2be9db7474ab58aac1bba00f6b2 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:11.457271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96af79-5266-45c9-af00-d05d9e162a57 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:11.457826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96af79-5266-45c9-af00-d05d9e162a57 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:11.458044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96af79-5266-45c9-af00-d05d9e162a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:11.479085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ec96af79-5266-45c9-af00-d05d9e162a57 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:11.480351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ec96af79-5266-45c9-af00-d05d9e162a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:11.554155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1206/2416] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:52:11.565090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:11.567455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:11.636953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b06f00-dd32-4fbc-a87a-bf7b9b8a715b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:11.640817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d273-0b22-435d-a8df-5214c520575b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:11.641563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d273-0b22-435d-a8df-5214c520575b service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:11.641892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d273-0b22-435d-a8df-5214c520575b service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:11.642196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d273-0b22-435d-a8df-5214c520575b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:11.652371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7d273-0b22-435d-a8df-5214c520575b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:11.654656 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7d273-0b22-435d-a8df-5214c520575b service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:11.664834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1211/2417] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:12.217782 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96af79-5266-45c9-af00-d05d9e162a57 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:12.219224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ec96af79-5266-45c9-af00-d05d9e162a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:12.231637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96af79-5266-45c9-af00-d05d9e162a57 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:12.237422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:12.238415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:12.238701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:12.238977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] PATH_INFO: `/v3/projects/feb3d2ad85244b7f89f1ea27fa985d7b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:12.240283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feb3d2ad85244b7f89f1ea27fa985d7b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:12.242134 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:12.389605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:12.392578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feb3d2ad85244b7f89f1ea27fa985d7b', 'request_id': 'req-530dc836-dfb6-48c7-90b6-3d07df357db7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:12.398822 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feb3d2ad85244b7f89f1ea27fa985d7b', 'request_id': 'req-530dc836-dfb6-48c7-90b6-3d07df357db7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:12.406344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feb3d2ad85244b7f89f1ea27fa985d7b', 'request_id': 'req-530dc836-dfb6-48c7-90b6-3d07df357db7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:12.527618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] The token cache is being invalidate because project feb3d2ad85244b7f89f1ea27fa985d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:52:12.528679 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:12.529094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:12.532190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1207/2418] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:52:12 2022] DELETE /identity/v3/projects/feb3d2ad85244b7f89f1ea27fa985d7b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:12.536700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d273-0b22-435d-a8df-5214c520575b service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:12.546767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d273-0b22-435d-a8df-5214c520575b service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:12.577707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:12.616648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:12.620952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:12.620952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:12.620952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] PATH_INFO: `/v3/users/ad1d861f9a0f4cf5a0b06d0fc5c88c08` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:12.620952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad1d861f9a0f4cf5a0b06d0fc5c88c08)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:12.622348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:12.858635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad1d861f9a0f4cf5a0b06d0fc5c88c08'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:12.859390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad1d861f9a0f4cf5a0b06d0fc5c88c08'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:12.922715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad1d861f9a0f4cf5a0b06d0fc5c88c08'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:12.923449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad1d861f9a0f4cf5a0b06d0fc5c88c08'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:12.937251 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-742c189d-ff21-47be-b09a-e2fbfeda5e9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad1d861f9a0f4cf5a0b06d0fc5c88c08'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:12.949526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1212/2419] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:52:12 2022] DELETE /identity/v3/users/ad1d861f9a0f4cf5a0b06d0fc5c88c08 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:13.440615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:13.444948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:13.458755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530dc836-dfb6-48c7-90b6-3d07df357db7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:13.539573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:13.540474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:13.540760 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:13.541038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] PATH_INFO: `/v3/projects/9ab1e31a6a1d4f1f8ee00c23db3720e0` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:13.542518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab1e31a6a1d4f1f8ee00c23db3720e0)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:13.546430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:13.728146 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab1e31a6a1d4f1f8ee00c23db3720e0', 'request_id': 'req-073ccf58-e662-4053-995d-6338a7b5601e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:13.736091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab1e31a6a1d4f1f8ee00c23db3720e0', 'request_id': 'req-073ccf58-e662-4053-995d-6338a7b5601e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:13.743082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab1e31a6a1d4f1f8ee00c23db3720e0', 'request_id': 'req-073ccf58-e662-4053-995d-6338a7b5601e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:13.865238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] The token cache is being invalidate because project 9ab1e31a6a1d4f1f8ee00c23db3720e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:52:13.870203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:13.870203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-073ccf58-e662-4053-995d-6338a7b5601e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:13.870203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1208/2420] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:52:13 2022] DELETE /identity/v3/projects/9ab1e31a6a1d4f1f8ee00c23db3720e0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:13.872847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6d32-9cff-4d83-8912-bce5d07a9f2e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:13.873305 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6d32-9cff-4d83-8912-bce5d07a9f2e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:13.873587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac6d32-9cff-4d83-8912-bce5d07a9f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:13.893887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-35ac6d32-9cff-4d83-8912-bce5d07a9f2e None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:13.899219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-35ac6d32-9cff-4d83-8912-bce5d07a9f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:13.970479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1213/2421] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:13.979189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046772-f6f8-467a-a565-23cc4e6c42fd None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:13.979474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046772-f6f8-467a-a565-23cc4e6c42fd None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:13.979756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046772-f6f8-467a-a565-23cc4e6c42fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:13.999693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-ba046772-f6f8-467a-a565-23cc4e6c42fd None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:14.000924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ba046772-f6f8-467a-a565-23cc4e6c42fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:14.014513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1209/2422] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:14.018663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac6d32-9cff-4d83-8912-bce5d07a9f2e None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:14.031219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac6d32-9cff-4d83-8912-bce5d07a9f2e None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:14.037043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fea957-2be9-4fd6-932a-e5b2ec4fafdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:14.037928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea957-2be9-4fd6-932a-e5b2ec4fafdb admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:14.038303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea957-2be9-4fd6-932a-e5b2ec4fafdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:14.038645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea957-2be9-4fd6-932a-e5b2ec4fafdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:14.039451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fea957-2be9-4fd6-932a-e5b2ec4fafdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:52:14.039826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fea957-2be9-4fd6-932a-e5b2ec4fafdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:14.041528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fea957-2be9-4fd6-932a-e5b2ec4fafdb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:14.057655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1214/2423] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:52:14.063507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba046772-f6f8-467a-a565-23cc4e6c42fd None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:14.074821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba046772-f6f8-467a-a565-23cc4e6c42fd None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:14.094259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac199da-541d-40c7-8efc-6c769a4c4708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:14.094259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac199da-541d-40c7-8efc-6c769a4c4708 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:14.094259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac199da-541d-40c7-8efc-6c769a4c4708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:14.094259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac199da-541d-40c7-8efc-6c769a4c4708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:14.095155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac199da-541d-40c7-8efc-6c769a4c4708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:14.095155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac199da-541d-40c7-8efc-6c769a4c4708 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:14.276246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1210/2424] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:52:14 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:14.280984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fea957-2be9-4fd6-932a-e5b2ec4fafdb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:14.296023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fea957-2be9-4fd6-932a-e5b2ec4fafdb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:14.333983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:14.360340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30665e45-3a84-464c-9a1f-b347e588a21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:14.361167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30665e45-3a84-464c-9a1f-b347e588a21c admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:14.361553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30665e45-3a84-464c-9a1f-b347e588a21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:14.361933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30665e45-3a84-464c-9a1f-b347e588a21c admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:14.362760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30665e45-3a84-464c-9a1f-b347e588a21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:14.368186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30665e45-3a84-464c-9a1f-b347e588a21c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:14.451917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1215/2425] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:52:14 2022] POST /identity/v3/users => generated 292 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:52:14.457101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac199da-541d-40c7-8efc-6c769a4c4708 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:14.473333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac199da-541d-40c7-8efc-6c769a4c4708 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:14.473333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6decb-3297-49e5-b43a-2cfa46d07992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:14.473333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6decb-3297-49e5-b43a-2cfa46d07992 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:14.473783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6decb-3297-49e5-b43a-2cfa46d07992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:14.474131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6decb-3297-49e5-b43a-2cfa46d07992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:14.474578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6decb-3297-49e5-b43a-2cfa46d07992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:14.476276 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6decb-3297-49e5-b43a-2cfa46d07992 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:14.487619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1211/2426] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:14.493655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30665e45-3a84-464c-9a1f-b347e588a21c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:14.507130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30665e45-3a84-464c-9a1f-b347e588a21c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:14.511693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7e29c-3191-4673-a3b1-3b690070c309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:14.514254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7e29c-3191-4673-a3b1-3b690070c309 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:14.514254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7e29c-3191-4673-a3b1-3b690070c309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:14.514254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7e29c-3191-4673-a3b1-3b690070c309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:14.514254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7e29c-3191-4673-a3b1-3b690070c309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:14.516067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7e29c-3191-4673-a3b1-3b690070c309 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:14.526889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1216/2427] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:14.531217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6decb-3297-49e5-b43a-2cfa46d07992 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:14.542229 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6decb-3297-49e5-b43a-2cfa46d07992 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:14.549492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0641e34-77e6-41cc-a655-f0f83e102a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:14.550409 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0641e34-77e6-41cc-a655-f0f83e102a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:14.550696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0641e34-77e6-41cc-a655-f0f83e102a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:14.550977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0641e34-77e6-41cc-a655-f0f83e102a25 admin admin] PATH_INFO: `/v3/projects/535fe89d10b641948457bcd35bc6a5b1/users/d43597cd4e914d1b87698ccea8561c04/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:14.567449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0641e34-77e6-41cc-a655-f0f83e102a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535fe89d10b641948457bcd35bc6a5b1, user_id=d43597cd4e914d1b87698ccea8561c04, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:14.572048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0641e34-77e6-41cc-a655-f0f83e102a25 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:14.617362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:14.623600 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1212/2428] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:52:14 2022] PUT /identity/v3/projects/535fe89d10b641948457bcd35bc6a5b1/users/d43597cd4e914d1b87698ccea8561c04/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:14.635371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125ed0a-fc3f-4f25-94de-5f5ec8ce6fd3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:14.635664 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125ed0a-fc3f-4f25-94de-5f5ec8ce6fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:14.635947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125ed0a-fc3f-4f25-94de-5f5ec8ce6fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:14.663780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b125ed0a-fc3f-4f25-94de-5f5ec8ce6fd3 None None] MFA Rules not processed for user `d43597cd4e914d1b87698ccea8561c04`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:14.665077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b125ed0a-fc3f-4f25-94de-5f5ec8ce6fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:14.728841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1217/2429] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:14.734086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0641e34-77e6-41cc-a655-f0f83e102a25 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:14.800862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0641e34-77e6-41cc-a655-f0f83e102a25 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:14.805604 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a6ac-2abc-49a5-9a33-fed2b2a72072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:14.806285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a6ac-2abc-49a5-9a33-fed2b2a72072 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:14.806574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a6ac-2abc-49a5-9a33-fed2b2a72072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:14.806856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a6ac-2abc-49a5-9a33-fed2b2a72072 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:14.807540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a6ac-2abc-49a5-9a33-fed2b2a72072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:14.809435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a6ac-2abc-49a5-9a33-fed2b2a72072 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:14.891075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1213/2430] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:52:14 2022] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:14.895122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125ed0a-fc3f-4f25-94de-5f5ec8ce6fd3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:14.906497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125ed0a-fc3f-4f25-94de-5f5ec8ce6fd3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:14.961488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9318e9-f9f6-4aff-bfa2-79b185a5e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:14.962180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9318e9-f9f6-4aff-bfa2-79b185a5e676 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:14.962482 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9318e9-f9f6-4aff-bfa2-79b185a5e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:14.962743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9318e9-f9f6-4aff-bfa2-79b185a5e676 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:14.963420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9318e9-f9f6-4aff-bfa2-79b185a5e676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:14.965364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9318e9-f9f6-4aff-bfa2-79b185a5e676 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:15.038662 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1218/2431] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:52:14 2022] POST /identity/v3/users => generated 297 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:15.042808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a6ac-2abc-49a5-9a33-fed2b2a72072 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:15.053714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a6ac-2abc-49a5-9a33-fed2b2a72072 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:15.058375 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840e34f-6963-45a4-a13d-1f1fb2a3c728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:15.059026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840e34f-6963-45a4-a13d-1f1fb2a3c728 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:15.059314 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840e34f-6963-45a4-a13d-1f1fb2a3c728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:15.059596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840e34f-6963-45a4-a13d-1f1fb2a3c728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:15.060359 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840e34f-6963-45a4-a13d-1f1fb2a3c728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:15.061995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840e34f-6963-45a4-a13d-1f1fb2a3c728 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:15.072862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1214/2432] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:52:15.076987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9318e9-f9f6-4aff-bfa2-79b185a5e676 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:15.087573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9318e9-f9f6-4aff-bfa2-79b185a5e676 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:15.093125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f88c6-c941-4548-a16d-2e46320fd505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:15.096586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f88c6-c941-4548-a16d-2e46320fd505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:15.096586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f88c6-c941-4548-a16d-2e46320fd505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:15.096586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f88c6-c941-4548-a16d-2e46320fd505 admin admin] PATH_INFO: `/v3/projects/f3438abfa4a04b08937e7487cc0c278f/users/1eb6900becc642c7894e557be62ef689/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:15.110789 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f88c6-c941-4548-a16d-2e46320fd505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3438abfa4a04b08937e7487cc0c278f, user_id=1eb6900becc642c7894e557be62ef689, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:15.113459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f88c6-c941-4548-a16d-2e46320fd505 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:15.222645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1219/2433] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:52:15 2022] PUT /identity/v3/projects/f3438abfa4a04b08937e7487cc0c278f/users/1eb6900becc642c7894e557be62ef689/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:15.226692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840e34f-6963-45a4-a13d-1f1fb2a3c728 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:15.237525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840e34f-6963-45a4-a13d-1f1fb2a3c728 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:15.294134 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15942096-3d8a-432a-b3b3-36c7f45a702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:15.295437 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15942096-3d8a-432a-b3b3-36c7f45a702b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:15.295662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15942096-3d8a-432a-b3b3-36c7f45a702b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:15.295941 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15942096-3d8a-432a-b3b3-36c7f45a702b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:15.296653 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15942096-3d8a-432a-b3b3-36c7f45a702b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:15.298288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15942096-3d8a-432a-b3b3-36c7f45a702b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:15.308188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1215/2434] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:15.312300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f88c6-c941-4548-a16d-2e46320fd505 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:15.322678 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f88c6-c941-4548-a16d-2e46320fd505 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:15.327934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b5ab-44b6-456b-a7a5-b9f8a1ce7176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:15.328804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b5ab-44b6-456b-a7a5-b9f8a1ce7176 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:15.329088 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b5ab-44b6-456b-a7a5-b9f8a1ce7176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:15.329364 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5b5ab-44b6-456b-a7a5-b9f8a1ce7176 admin admin] PATH_INFO: `/v3/projects/f3438abfa4a04b08937e7487cc0c278f/users/1eb6900becc642c7894e557be62ef689/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:15.331337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b5ab-44b6-456b-a7a5-b9f8a1ce7176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3438abfa4a04b08937e7487cc0c278f, user_id=1eb6900becc642c7894e557be62ef689, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:15.334039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5b5ab-44b6-456b-a7a5-b9f8a1ce7176 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:15.339486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:15.345384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1220/2435] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:52:15 2022] PUT /identity/v3/projects/f3438abfa4a04b08937e7487cc0c278f/users/1eb6900becc642c7894e557be62ef689/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:15.360663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22255f35-4bb8-4a22-9752-f0612315f1c1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:15.360954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22255f35-4bb8-4a22-9752-f0612315f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:15.361234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22255f35-4bb8-4a22-9752-f0612315f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:15.387056 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-22255f35-4bb8-4a22-9752-f0612315f1c1 None None] MFA Rules not processed for user `1eb6900becc642c7894e557be62ef689`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:15.388249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-22255f35-4bb8-4a22-9752-f0612315f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:15.446101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:15.461527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1216/2436] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:15.473028 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b5ab-44b6-456b-a7a5-b9f8a1ce7176 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:15.474715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-04a5b5ab-44b6-456b-a7a5-b9f8a1ce7176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:15.537469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5b5ab-44b6-456b-a7a5-b9f8a1ce7176 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:15.541316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e999636a-d45f-4b0b-9847-bfbdcbdd7390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:15.541999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999636a-d45f-4b0b-9847-bfbdcbdd7390 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:15.542288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999636a-d45f-4b0b-9847-bfbdcbdd7390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:15.542563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999636a-d45f-4b0b-9847-bfbdcbdd7390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:15.552144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999636a-d45f-4b0b-9847-bfbdcbdd7390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:15.553595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e999636a-d45f-4b0b-9847-bfbdcbdd7390 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:15.563160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1221/2437] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:52:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:15.670908 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22255f35-4bb8-4a22-9752-f0612315f1c1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:15.680462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22255f35-4bb8-4a22-9752-f0612315f1c1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:15.683961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861d48f-0474-44d5-b073-283c73e0db12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:15.684590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d48f-0474-44d5-b073-283c73e0db12 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:15.684872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d48f-0474-44d5-b073-283c73e0db12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:15.685148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d48f-0474-44d5-b073-283c73e0db12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:15.742141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861d48f-0474-44d5-b073-283c73e0db12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:15.743673 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861d48f-0474-44d5-b073-283c73e0db12 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:15.753763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1217/2438] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:52:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:16.492521 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869bab-19f6-46cf-bbd5-06e29ec78ab9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:16.493013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869bab-19f6-46cf-bbd5-06e29ec78ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:16.493107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb869bab-19f6-46cf-bbd5-06e29ec78ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:16.516271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-eb869bab-19f6-46cf-bbd5-06e29ec78ab9 None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:16.517512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eb869bab-19f6-46cf-bbd5-06e29ec78ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:16.575878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1222/2439] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:16.750542 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861d48f-0474-44d5-b073-283c73e0db12 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:16.752041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7861d48f-0474-44d5-b073-283c73e0db12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:16.831356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861d48f-0474-44d5-b073-283c73e0db12 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:16.836605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc04778-88be-4a33-a36c-b614e7dcc0da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:16.837191 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc04778-88be-4a33-a36c-b614e7dcc0da service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:16.837480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc04778-88be-4a33-a36c-b614e7dcc0da service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:16.837795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc04778-88be-4a33-a36c-b614e7dcc0da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:16.847002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc04778-88be-4a33-a36c-b614e7dcc0da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:16.848615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc04778-88be-4a33-a36c-b614e7dcc0da service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:16.856824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1218/2440] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:52:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:52:19.061754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb869bab-19f6-46cf-bbd5-06e29ec78ab9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:19.231085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb869bab-19f6-46cf-bbd5-06e29ec78ab9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:19.240273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:19.241289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:19.241657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:19.242011 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] PATH_INFO: `/v3/users/d43597cd4e914d1b87698ccea8561c04` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:19.243707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d43597cd4e914d1b87698ccea8561c04)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:19.245937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:19.495231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd43597cd4e914d1b87698ccea8561c04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:19.496040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd43597cd4e914d1b87698ccea8561c04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:19.498526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:19.873701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd43597cd4e914d1b87698ccea8561c04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:19.874603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd43597cd4e914d1b87698ccea8561c04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:19.892089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd43597cd4e914d1b87698ccea8561c04'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:19.904311 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1223/2441] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:52:19 2022] DELETE /identity/v3/users/d43597cd4e914d1b87698ccea8561c04 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:19.909391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df691-c174-44ee-8f28-9860070b855c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:19.909921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df691-c174-44ee-8f28-9860070b855c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:19.911163 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df691-c174-44ee-8f28-9860070b855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:19.945921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-181df691-c174-44ee-8f28-9860070b855c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:19.947165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-181df691-c174-44ee-8f28-9860070b855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:20.035433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1219/2442] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:20.046126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:20.048022 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:20.117820 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be7170-f277-47c4-8c48-b71580de2d76 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:20.121883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a226-01be-4cf0-88c3-2e3316862c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:20.122730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a226-01be-4cf0-88c3-2e3316862c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:20.123012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a226-01be-4cf0-88c3-2e3316862c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:20.123309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722a226-01be-4cf0-88c3-2e3316862c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:20.135224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a226-01be-4cf0-88c3-2e3316862c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:20.136693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722a226-01be-4cf0-88c3-2e3316862c68 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:20.149702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1224/2443] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:20.745245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df691-c174-44ee-8f28-9860070b855c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:20.752722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-181df691-c174-44ee-8f28-9860070b855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:20.775466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df691-c174-44ee-8f28-9860070b855c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:20.781752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:20.782991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:20.783250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:20.783531 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] PATH_INFO: `/v3/projects/535fe89d10b641948457bcd35bc6a5b1` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:20.784739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535fe89d10b641948457bcd35bc6a5b1)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:20.786747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:20.824721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:20.969253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535fe89d10b641948457bcd35bc6a5b1', 'request_id': 'req-f94265b5-9055-4179-addb-83f63133b106'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:20.975844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535fe89d10b641948457bcd35bc6a5b1', 'request_id': 'req-f94265b5-9055-4179-addb-83f63133b106'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:20.984506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535fe89d10b641948457bcd35bc6a5b1', 'request_id': 'req-f94265b5-9055-4179-addb-83f63133b106'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:21.088512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] The token cache is being invalidate because project 535fe89d10b641948457bcd35bc6a5b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:52:21.088880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:21.089622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:21.092024 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1220/2444] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:52:20 2022] DELETE /identity/v3/projects/535fe89d10b641948457bcd35bc6a5b1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:21.096178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a226-01be-4cf0-88c3-2e3316862c68 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:21.118653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722a226-01be-4cf0-88c3-2e3316862c68 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:21.213090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:21.215989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:21.216285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:21.217108 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] PATH_INFO: `/v3/users/1eb6900becc642c7894e557be62ef689` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:21.218547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb6900becc642c7894e557be62ef689)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:21.220787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:21.437419 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb6900becc642c7894e557be62ef689'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:21.438450 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb6900becc642c7894e557be62ef689'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:21.507044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb6900becc642c7894e557be62ef689'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:21.507733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb6900becc642c7894e557be62ef689'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:21.526881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:21.528612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-92e68e55-a0f8-485e-9df9-69ef05e6a019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb6900becc642c7894e557be62ef689'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:21.546579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1225/2445] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:52:21 2022] DELETE /identity/v3/users/1eb6900becc642c7894e557be62ef689 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:52:22.124193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:22.126481 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:22.159805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94265b5-9055-4179-addb-83f63133b106 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:22.258092 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:22.259063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:22.259455 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:22.259802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] PATH_INFO: `/v3/projects/f3438abfa4a04b08937e7487cc0c278f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:22.261141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3438abfa4a04b08937e7487cc0c278f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:22.263743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:22.440586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3438abfa4a04b08937e7487cc0c278f', 'request_id': 'req-49146ea7-877b-4eb6-8443-e351ce69564b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:22.454136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3438abfa4a04b08937e7487cc0c278f', 'request_id': 'req-49146ea7-877b-4eb6-8443-e351ce69564b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:22.468632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3438abfa4a04b08937e7487cc0c278f', 'request_id': 'req-49146ea7-877b-4eb6-8443-e351ce69564b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:22.557265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] The token cache is being invalidate because project f3438abfa4a04b08937e7487cc0c278f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:52:22.557722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:22.560824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-49146ea7-877b-4eb6-8443-e351ce69564b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:22.561975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1221/2446] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:52:22 2022] DELETE /identity/v3/projects/f3438abfa4a04b08937e7487cc0c278f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:22.567357 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b64ca-9a9a-4fb6-b0d5-5701db6858ab None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:22.567813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b64ca-9a9a-4fb6-b0d5-5701db6858ab None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:22.567933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b64ca-9a9a-4fb6-b0d5-5701db6858ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:22.592950 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-275b64ca-9a9a-4fb6-b0d5-5701db6858ab None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:22.594496 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-275b64ca-9a9a-4fb6-b0d5-5701db6858ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:22.696346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1226/2447] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:52:22.697831 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bb600-27b0-415f-90ca-b6e535a81b4c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:22.698131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bb600-27b0-415f-90ca-b6e535a81b4c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:22.698418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bb600-27b0-415f-90ca-b6e535a81b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:22.727833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-897bb600-27b0-415f-90ca-b6e535a81b4c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:22.729742 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-897bb600-27b0-415f-90ca-b6e535a81b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:22.739663 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1222/2448] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:52:22.744265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b64ca-9a9a-4fb6-b0d5-5701db6858ab None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:22.764861 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b64ca-9a9a-4fb6-b0d5-5701db6858ab None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:22.770399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe525aa3-2227-4aef-b5d0-05b4063d3631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:22.771112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe525aa3-2227-4aef-b5d0-05b4063d3631 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:22.771426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe525aa3-2227-4aef-b5d0-05b4063d3631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:22.771670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe525aa3-2227-4aef-b5d0-05b4063d3631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:22.772409 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe525aa3-2227-4aef-b5d0-05b4063d3631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:52:22.772717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe525aa3-2227-4aef-b5d0-05b4063d3631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:22.774702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe525aa3-2227-4aef-b5d0-05b4063d3631 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:22.798493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1227/2449] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:52:22.800501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bb600-27b0-415f-90ca-b6e535a81b4c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:22.814626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bb600-27b0-415f-90ca-b6e535a81b4c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:22.821682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2cc47-9bf6-4cc2-ae44-b07754b94e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:22.821932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2cc47-9bf6-4cc2-ae44-b07754b94e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:22.822358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2cc47-9bf6-4cc2-ae44-b07754b94e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:22.822746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2cc47-9bf6-4cc2-ae44-b07754b94e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:22.824060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2cc47-9bf6-4cc2-ae44-b07754b94e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:22.829039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2cc47-9bf6-4cc2-ae44-b07754b94e98 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:22.948366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1223/2450] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:52:22 2022] POST /identity/v3/projects => generated 363 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:22.957483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe525aa3-2227-4aef-b5d0-05b4063d3631 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:22.977737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe525aa3-2227-4aef-b5d0-05b4063d3631 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:23.094563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5645b44-394c-437c-943e-d32c27777ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:23.095287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5645b44-394c-437c-943e-d32c27777ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:23.095581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5645b44-394c-437c-943e-d32c27777ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:23.095857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5645b44-394c-437c-943e-d32c27777ac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:23.096568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5645b44-394c-437c-943e-d32c27777ac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:23.099645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5645b44-394c-437c-943e-d32c27777ac6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:23.427337 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1228/2451] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:52:22 2022] POST /identity/v3/users => generated 282 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:52:23.432603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2cc47-9bf6-4cc2-ae44-b07754b94e98 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:23.443879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2cc47-9bf6-4cc2-ae44-b07754b94e98 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:23.448712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62262ea-43a1-4426-9991-6db9cec2e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:23.449366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62262ea-43a1-4426-9991-6db9cec2e444 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:23.449649 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62262ea-43a1-4426-9991-6db9cec2e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:23.449952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62262ea-43a1-4426-9991-6db9cec2e444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:23.450670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62262ea-43a1-4426-9991-6db9cec2e444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:23.452293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62262ea-43a1-4426-9991-6db9cec2e444 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:23.454544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:23.463670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1224/2452] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:23.468389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5645b44-394c-437c-943e-d32c27777ac6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:23.479156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5645b44-394c-437c-943e-d32c27777ac6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:23.484425 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be207d-7d3a-40f8-9b1b-a5288cf353f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:23.485090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be207d-7d3a-40f8-9b1b-a5288cf353f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:23.485402 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be207d-7d3a-40f8-9b1b-a5288cf353f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:23.485692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be207d-7d3a-40f8-9b1b-a5288cf353f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:23.486424 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be207d-7d3a-40f8-9b1b-a5288cf353f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:23.488084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be207d-7d3a-40f8-9b1b-a5288cf353f4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:23.499169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1229/2453] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:52:23.503810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62262ea-43a1-4426-9991-6db9cec2e444 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:23.514785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62262ea-43a1-4426-9991-6db9cec2e444 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:23.519637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4495708-7bc8-4d14-91bc-6a5026718804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:23.520530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495708-7bc8-4d14-91bc-6a5026718804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:23.520817 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495708-7bc8-4d14-91bc-6a5026718804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:23.521209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495708-7bc8-4d14-91bc-6a5026718804 admin admin] PATH_INFO: `/v3/projects/bf64893f0d414db1818c0551e6b22486/users/52d3ae2a739544e098122cd79026bf71/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:23.537327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4495708-7bc8-4d14-91bc-6a5026718804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf64893f0d414db1818c0551e6b22486, user_id=52d3ae2a739544e098122cd79026bf71, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:23.539995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4495708-7bc8-4d14-91bc-6a5026718804 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:23.736596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1225/2454] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:52:23 2022] PUT /identity/v3/projects/bf64893f0d414db1818c0551e6b22486/users/52d3ae2a739544e098122cd79026bf71/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:23.748063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414ef2-20e3-4104-9265-46b8e220d1b4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:23.748627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414ef2-20e3-4104-9265-46b8e220d1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:23.748627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04414ef2-20e3-4104-9265-46b8e220d1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:23.777685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-04414ef2-20e3-4104-9265-46b8e220d1b4 None None] MFA Rules not processed for user `52d3ae2a739544e098122cd79026bf71`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:23.778979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-04414ef2-20e3-4104-9265-46b8e220d1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:23.828639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:23.852625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1230/2455] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:23.864180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4495708-7bc8-4d14-91bc-6a5026718804 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:23.866127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-c4495708-7bc8-4d14-91bc-6a5026718804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:23.963220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4495708-7bc8-4d14-91bc-6a5026718804 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:23.967992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92880d-b257-4203-9157-7a1835f1b26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:23.968791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92880d-b257-4203-9157-7a1835f1b26d service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:23.969183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92880d-b257-4203-9157-7a1835f1b26d service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:23.969562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92880d-b257-4203-9157-7a1835f1b26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:23.980677 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92880d-b257-4203-9157-7a1835f1b26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:23.985932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92880d-b257-4203-9157-7a1835f1b26d service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:23.990036 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04414ef2-20e3-4104-9265-46b8e220d1b4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:23.991501 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-04414ef2-20e3-4104-9265-46b8e220d1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:23.998950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1226/2456] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:52:23 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:24.139475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04414ef2-20e3-4104-9265-46b8e220d1b4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:24.146596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56caedb-175d-49ad-85e3-044c6815b5b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:24.147267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56caedb-175d-49ad-85e3-044c6815b5b1 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:24.148191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56caedb-175d-49ad-85e3-044c6815b5b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:24.148191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56caedb-175d-49ad-85e3-044c6815b5b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:24.159373 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c56caedb-175d-49ad-85e3-044c6815b5b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:24.175660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56caedb-175d-49ad-85e3-044c6815b5b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:24.178785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56caedb-175d-49ad-85e3-044c6815b5b1 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:24.197743 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1231/2457] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:52:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:33.993700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:34.190473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=42 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:39.219789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbec700-b482-4a39-829b-6077fa0ebdba None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:39.221683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbec700-b482-4a39-829b-6077fa0ebdba None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:39.222190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbec700-b482-4a39-829b-6077fa0ebdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:39.241758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6cbec700-b482-4a39-829b-6077fa0ebdba None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:39.243167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6cbec700-b482-4a39-829b-6077fa0ebdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:39.303487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1227/2458] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:39.315908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56caedb-175d-49ad-85e3-044c6815b5b1 service nova] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:39.317508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c56caedb-175d-49ad-85e3-044c6815b5b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:39.395690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56caedb-175d-49ad-85e3-044c6815b5b1 service nova] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:39.400854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab114c-2c8d-4b90-8560-1dc587118cb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:39.401535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab114c-2c8d-4b90-8560-1dc587118cb7 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:39.401854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab114c-2c8d-4b90-8560-1dc587118cb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:39.402130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab114c-2c8d-4b90-8560-1dc587118cb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:39.411554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab114c-2c8d-4b90-8560-1dc587118cb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:39.417905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab114c-2c8d-4b90-8560-1dc587118cb7 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:39.421610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1232/2459] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:52:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:52:49.296691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=25 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:49.418204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=32 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:54.415994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e3462-cae1-48c2-b559-e11f0fe578ee None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:54.415994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e3462-cae1-48c2-b559-e11f0fe578ee None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:54.416464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1e3462-cae1-48c2-b559-e11f0fe578ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:54.436059 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2e1e3462-cae1-48c2-b559-e11f0fe578ee None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:54.437448 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2e1e3462-cae1-48c2-b559-e11f0fe578ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:54.445621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1228/2460] 10.222.0.41 () {58 vars in 967 bytes} [Thu May 26 12:52:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:54.463350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab114c-2c8d-4b90-8560-1dc587118cb7 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:54.474640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab114c-2c8d-4b90-8560-1dc587118cb7 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:54.480707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa953cfe-2459-4da7-9723-816ec5ea95e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:54.481537 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa953cfe-2459-4da7-9723-816ec5ea95e3 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:54.482624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa953cfe-2459-4da7-9723-816ec5ea95e3 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:54.482908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa953cfe-2459-4da7-9723-816ec5ea95e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:54.492409 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa953cfe-2459-4da7-9723-816ec5ea95e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:54.494092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa953cfe-2459-4da7-9723-816ec5ea95e3 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:54.503733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1233/2461] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:53:04.429515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:04.499935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:06.088127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e3462-cae1-48c2-b559-e11f0fe578ee None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:06.150103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1e3462-cae1-48c2-b559-e11f0fe578ee None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:06.154557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:06.155930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.156211 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.156488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] PATH_INFO: `/v3/users/52d3ae2a739544e098122cd79026bf71` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.157684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d3ae2a739544e098122cd79026bf71)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:06.159594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:06.364072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d3ae2a739544e098122cd79026bf71'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:06.453229 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d3ae2a739544e098122cd79026bf71'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:06.453874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d3ae2a739544e098122cd79026bf71'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:06.454524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d3ae2a739544e098122cd79026bf71'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:06.467391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d3ae2a739544e098122cd79026bf71'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:06.480347 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1229/2462] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:53:06 2022] DELETE /identity/v3/users/52d3ae2a739544e098122cd79026bf71 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:06.484828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d032f9-d268-4fb7-a907-92bc34e8815b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.486168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d032f9-d268-4fb7-a907-92bc34e8815b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.486168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d032f9-d268-4fb7-a907-92bc34e8815b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.502166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-77d032f9-d268-4fb7-a907-92bc34e8815b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:06.503350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-77d032f9-d268-4fb7-a907-92bc34e8815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:06.561953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1234/2463] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:06.571638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:06.573070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:06.632319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd46784b-6748-4b1c-ae33-5c5a0a85db72 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:06.635917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cbc68-05f2-441f-9312-ce98c4d5bfb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:06.636570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cbc68-05f2-441f-9312-ce98c4d5bfb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.636855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cbc68-05f2-441f-9312-ce98c4d5bfb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.637136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cbc68-05f2-441f-9312-ce98c4d5bfb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.646852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cbc68-05f2-441f-9312-ce98c4d5bfb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:06.648274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cbc68-05f2-441f-9312-ce98c4d5bfb2 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:06.658291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1230/2464] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:07.135610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d032f9-d268-4fb7-a907-92bc34e8815b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:07.137974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-77d032f9-d268-4fb7-a907-92bc34e8815b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:07.155852 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d032f9-d268-4fb7-a907-92bc34e8815b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:07.165147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:07.165147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:07.165147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:07.165147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] PATH_INFO: `/v3/projects/bf64893f0d414db1818c0551e6b22486` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:07.165516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf64893f0d414db1818c0551e6b22486)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:07.167285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:07.296920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf64893f0d414db1818c0551e6b22486', 'request_id': 'req-dc563319-1b18-4bbe-8541-3af990eb501c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:07.302886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf64893f0d414db1818c0551e6b22486', 'request_id': 'req-dc563319-1b18-4bbe-8541-3af990eb501c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:07.309176 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf64893f0d414db1818c0551e6b22486', 'request_id': 'req-dc563319-1b18-4bbe-8541-3af990eb501c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:07.403098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] The token cache is being invalidate because project bf64893f0d414db1818c0551e6b22486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:53:07.403516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:07.404139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-dc563319-1b18-4bbe-8541-3af990eb501c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:07.406667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1235/2465] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:53:07 2022] DELETE /identity/v3/projects/bf64893f0d414db1818c0551e6b22486 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:07.411559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600a431-a570-4ca5-a3e8-9da1b078b517 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:07.412063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600a431-a570-4ca5-a3e8-9da1b078b517 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:07.412416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600a431-a570-4ca5-a3e8-9da1b078b517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:07.431149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a600a431-a570-4ca5-a3e8-9da1b078b517 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:07.432371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a600a431-a570-4ca5-a3e8-9da1b078b517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:07.450540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:07.496780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1231/2466] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:07.505089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094548-2253-4d75-9190-92eced738b10 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:07.511320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094548-2253-4d75-9190-92eced738b10 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:07.511320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094548-2253-4d75-9190-92eced738b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:07.524659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-24094548-2253-4d75-9190-92eced738b10 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:07.525891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-24094548-2253-4d75-9190-92eced738b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:07.533953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1236/2467] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:07.538310 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600a431-a570-4ca5-a3e8-9da1b078b517 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:07.547950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600a431-a570-4ca5-a3e8-9da1b078b517 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:07.552647 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604dfe8-8635-4efa-9781-4d55536857c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:07.553300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604dfe8-8635-4efa-9781-4d55536857c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:07.553590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604dfe8-8635-4efa-9781-4d55536857c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:07.553907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604dfe8-8635-4efa-9781-4d55536857c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:07.554638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604dfe8-8635-4efa-9781-4d55536857c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:53:07.554955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604dfe8-8635-4efa-9781-4d55536857c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:07.556579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604dfe8-8635-4efa-9781-4d55536857c3 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:07.568660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1232/2468] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:53:07.572945 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24094548-2253-4d75-9190-92eced738b10 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:07.583151 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24094548-2253-4d75-9190-92eced738b10 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:07.588126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1188-fbcb-4e28-8cfd-0ac514f76a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:07.588784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1188-fbcb-4e28-8cfd-0ac514f76a7f admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:07.589071 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1188-fbcb-4e28-8cfd-0ac514f76a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:07.589378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a1188-fbcb-4e28-8cfd-0ac514f76a7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:07.590286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a1188-fbcb-4e28-8cfd-0ac514f76a7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:07.592198 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a1188-fbcb-4e28-8cfd-0ac514f76a7f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:07.700564 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1237/2469] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:53:07 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:07.705213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604dfe8-8635-4efa-9781-4d55536857c3 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:07.715381 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604dfe8-8635-4efa-9781-4d55536857c3 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:07.772063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dc158-e6ae-47b2-8212-a8a7ed75ec0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:07.772727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc158-e6ae-47b2-8212-a8a7ed75ec0f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:07.773018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc158-e6ae-47b2-8212-a8a7ed75ec0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:07.773319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc158-e6ae-47b2-8212-a8a7ed75ec0f admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:07.774043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dc158-e6ae-47b2-8212-a8a7ed75ec0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:07.775947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dc158-e6ae-47b2-8212-a8a7ed75ec0f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:07.865897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1233/2470] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:53:07 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:07.869742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1188-fbcb-4e28-8cfd-0ac514f76a7f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:07.880569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a1188-fbcb-4e28-8cfd-0ac514f76a7f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:07.885122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f102ff-748d-4230-a9ef-5c563682be47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:07.885813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f102ff-748d-4230-a9ef-5c563682be47 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:07.886099 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f102ff-748d-4230-a9ef-5c563682be47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:07.886377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f102ff-748d-4230-a9ef-5c563682be47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:07.887095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f102ff-748d-4230-a9ef-5c563682be47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:07.888761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f102ff-748d-4230-a9ef-5c563682be47 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:07.898952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1238/2471] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:07.902822 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dc158-e6ae-47b2-8212-a8a7ed75ec0f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:07.912813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dc158-e6ae-47b2-8212-a8a7ed75ec0f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:07.917494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b663e-2ffb-4865-8f33-a1c11a8d7be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:07.918192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b663e-2ffb-4865-8f33-a1c11a8d7be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:07.918486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b663e-2ffb-4865-8f33-a1c11a8d7be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:07.918772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b663e-2ffb-4865-8f33-a1c11a8d7be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:07.919504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b663e-2ffb-4865-8f33-a1c11a8d7be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:07.921650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b663e-2ffb-4865-8f33-a1c11a8d7be0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:07.932948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1234/2472] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:53:07.937634 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f102ff-748d-4230-a9ef-5c563682be47 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:07.947640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f102ff-748d-4230-a9ef-5c563682be47 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:07.952289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f539598-34ae-4881-a57a-e2e8073094be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:07.953096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539598-34ae-4881-a57a-e2e8073094be admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:07.953378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539598-34ae-4881-a57a-e2e8073094be admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:07.953676 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f539598-34ae-4881-a57a-e2e8073094be admin admin] PATH_INFO: `/v3/projects/7641923fd63e481e82dcd89f5b6ab803/users/23b1baa8985d4d2cae0228951a90fae6/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:07.967998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f539598-34ae-4881-a57a-e2e8073094be admin admin] RBAC: Authorizing `identity:create_grant(project_id=7641923fd63e481e82dcd89f5b6ab803, user_id=23b1baa8985d4d2cae0228951a90fae6, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:07.970703 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f539598-34ae-4881-a57a-e2e8073094be admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:08.089612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1239/2473] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:07 2022] PUT /identity/v3/projects/7641923fd63e481e82dcd89f5b6ab803/users/23b1baa8985d4d2cae0228951a90fae6/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:53:08.101307 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178104d-f580-46bf-8911-20418428524c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:08.101601 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178104d-f580-46bf-8911-20418428524c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:08.101922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178104d-f580-46bf-8911-20418428524c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:08.129015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3178104d-f580-46bf-8911-20418428524c None None] MFA Rules not processed for user `23b1baa8985d4d2cae0228951a90fae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:08.130360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3178104d-f580-46bf-8911-20418428524c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:08.193737 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1235/2474] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:08.205104 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f539598-34ae-4881-a57a-e2e8073094be admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:08.206902 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7f539598-34ae-4881-a57a-e2e8073094be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:08.229377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:08.263412 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f539598-34ae-4881-a57a-e2e8073094be admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:08.267744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a959a9b-3d4e-43fc-a4f1-165ffcca6587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:08.268384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a959a9b-3d4e-43fc-a4f1-165ffcca6587 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:08.268665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a959a9b-3d4e-43fc-a4f1-165ffcca6587 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:08.268939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a959a9b-3d4e-43fc-a4f1-165ffcca6587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:08.277146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a959a9b-3d4e-43fc-a4f1-165ffcca6587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:08.278600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a959a9b-3d4e-43fc-a4f1-165ffcca6587 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:08.287881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1240/2475] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:08.312099 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178104d-f580-46bf-8911-20418428524c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:08.331484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:08.375236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178104d-f580-46bf-8911-20418428524c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:08.379904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:08.380758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:08.381045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:08.381323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] PATH_INFO: `/v3/users/23b1baa8985d4d2cae0228951a90fae6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:08.382553 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b1baa8985d4d2cae0228951a90fae6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:08.384473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:08.600330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b1baa8985d4d2cae0228951a90fae6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:08.688671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b1baa8985d4d2cae0228951a90fae6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:08.689284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b1baa8985d4d2cae0228951a90fae6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:08.689916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b1baa8985d4d2cae0228951a90fae6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:08.703001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b1baa8985d4d2cae0228951a90fae6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:08.715175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1236/2476] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:53:08 2022] DELETE /identity/v3/users/23b1baa8985d4d2cae0228951a90fae6 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:08.720468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee79ab1-656e-4b13-8769-69895c8985e8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:08.720949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee79ab1-656e-4b13-8769-69895c8985e8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:08.721401 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee79ab1-656e-4b13-8769-69895c8985e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:08.738077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-dee79ab1-656e-4b13-8769-69895c8985e8 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:08.739266 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dee79ab1-656e-4b13-8769-69895c8985e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:08.797356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1241/2477] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:08.820693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:08.822144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:08.879399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f791ac5-3e93-4bc6-8193-87d5c00b4f54 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:08.883039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302c89-25e5-4a79-a263-ed64f0b2a507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:08.883712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302c89-25e5-4a79-a263-ed64f0b2a507 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:08.883978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302c89-25e5-4a79-a263-ed64f0b2a507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:08.884262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302c89-25e5-4a79-a263-ed64f0b2a507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:08.894702 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302c89-25e5-4a79-a263-ed64f0b2a507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:08.896196 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302c89-25e5-4a79-a263-ed64f0b2a507 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:08.907564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1237/2478] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:09.336379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee79ab1-656e-4b13-8769-69895c8985e8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:09.337749 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dee79ab1-656e-4b13-8769-69895c8985e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:09.351394 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee79ab1-656e-4b13-8769-69895c8985e8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:09.356153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:09.357023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:09.357306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:09.357598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] PATH_INFO: `/v3/projects/7641923fd63e481e82dcd89f5b6ab803` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:09.359537 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7641923fd63e481e82dcd89f5b6ab803)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:09.361448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:09.454965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7641923fd63e481e82dcd89f5b6ab803', 'request_id': 'req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:09.460447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7641923fd63e481e82dcd89f5b6ab803', 'request_id': 'req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:09.466734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7641923fd63e481e82dcd89f5b6ab803', 'request_id': 'req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:09.543840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] The token cache is being invalidate because project 7641923fd63e481e82dcd89f5b6ab803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:53:09.544127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:09.544740 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-49f7cdde-b21b-408e-8c3b-f9d50ef3687a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:09.546818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1242/2479] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:53:09 2022] DELETE /identity/v3/projects/7641923fd63e481e82dcd89f5b6ab803 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:09.551669 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d9e61-9852-424d-bc14-111977f43608 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:09.553309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d9e61-9852-424d-bc14-111977f43608 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:09.553309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d9e61-9852-424d-bc14-111977f43608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:09.570376 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-725d9e61-9852-424d-bc14-111977f43608 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:09.571584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-725d9e61-9852-424d-bc14-111977f43608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:09.604995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:09.631958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1238/2480] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:09.639745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92117109-60ac-445e-a814-371ae7e00ac3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:09.640035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92117109-60ac-445e-a814-371ae7e00ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:09.640315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92117109-60ac-445e-a814-371ae7e00ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:09.658808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-92117109-60ac-445e-a814-371ae7e00ac3 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:09.659975 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-92117109-60ac-445e-a814-371ae7e00ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:09.667800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1243/2481] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:09.672605 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d9e61-9852-424d-bc14-111977f43608 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:09.682247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d9e61-9852-424d-bc14-111977f43608 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:09.687146 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d23fd-4eca-4c13-93ca-7824c435bb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:09.687796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d23fd-4eca-4c13-93ca-7824c435bb10 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:09.688087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d23fd-4eca-4c13-93ca-7824c435bb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:09.688371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d23fd-4eca-4c13-93ca-7824c435bb10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:09.689131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d23fd-4eca-4c13-93ca-7824c435bb10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:53:09.689439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d23fd-4eca-4c13-93ca-7824c435bb10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:09.691087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d23fd-4eca-4c13-93ca-7824c435bb10 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:09.703336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1239/2482] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:53:09.707526 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92117109-60ac-445e-a814-371ae7e00ac3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:09.716699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92117109-60ac-445e-a814-371ae7e00ac3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:09.721965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd060947-7590-4d6f-a39c-5aa307e0a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:09.722641 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd060947-7590-4d6f-a39c-5aa307e0a493 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:09.722924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd060947-7590-4d6f-a39c-5aa307e0a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:09.723201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd060947-7590-4d6f-a39c-5aa307e0a493 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:09.723886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd060947-7590-4d6f-a39c-5aa307e0a493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:09.725805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd060947-7590-4d6f-a39c-5aa307e0a493 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:09.814161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1244/2483] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:53:09 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:09.818360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d23fd-4eca-4c13-93ca-7824c435bb10 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:09.828915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d23fd-4eca-4c13-93ca-7824c435bb10 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:09.883634 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b48b9-4747-4cac-8d4b-921b2afb15c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:09.884295 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b48b9-4747-4cac-8d4b-921b2afb15c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:09.884582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b48b9-4747-4cac-8d4b-921b2afb15c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:09.884862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b48b9-4747-4cac-8d4b-921b2afb15c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:09.885557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b48b9-4747-4cac-8d4b-921b2afb15c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:09.887493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b48b9-4747-4cac-8d4b-921b2afb15c9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:09.980797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1240/2484] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:53:09 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:09.984798 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd060947-7590-4d6f-a39c-5aa307e0a493 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:09.995030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd060947-7590-4d6f-a39c-5aa307e0a493 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:10.000224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4bb67-bfd9-4cf9-8ed9-dd1cbf74ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:10.000870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bb67-bfd9-4cf9-8ed9-dd1cbf74ec84 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:10.001153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bb67-bfd9-4cf9-8ed9-dd1cbf74ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:10.001427 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4bb67-bfd9-4cf9-8ed9-dd1cbf74ec84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:10.002186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4bb67-bfd9-4cf9-8ed9-dd1cbf74ec84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:10.003782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4bb67-bfd9-4cf9-8ed9-dd1cbf74ec84 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:10.015663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1245/2485] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:10.019775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b48b9-4747-4cac-8d4b-921b2afb15c9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:10.029874 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b48b9-4747-4cac-8d4b-921b2afb15c9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:10.034625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d97e3-6ef7-4df6-9ea7-697721d8741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:10.035283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d97e3-6ef7-4df6-9ea7-697721d8741b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:10.039741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d97e3-6ef7-4df6-9ea7-697721d8741b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:10.039741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d97e3-6ef7-4df6-9ea7-697721d8741b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:10.039741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d97e3-6ef7-4df6-9ea7-697721d8741b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:10.039741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d97e3-6ef7-4df6-9ea7-697721d8741b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:10.049267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1241/2486] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:53:10.053525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4bb67-bfd9-4cf9-8ed9-dd1cbf74ec84 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:10.064324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4bb67-bfd9-4cf9-8ed9-dd1cbf74ec84 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:10.069008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2e958-45b0-4bf1-a8cb-dedbaefd63fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:10.070486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2e958-45b0-4bf1-a8cb-dedbaefd63fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:10.070486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2e958-45b0-4bf1-a8cb-dedbaefd63fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:10.070705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2e958-45b0-4bf1-a8cb-dedbaefd63fc admin admin] PATH_INFO: `/v3/projects/c876091609fe45ba80370a16748cbeb2/users/7277aedb35df448e8b3056f8bc395e32/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:10.072800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:10.086262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2e958-45b0-4bf1-a8cb-dedbaefd63fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c876091609fe45ba80370a16748cbeb2, user_id=7277aedb35df448e8b3056f8bc395e32, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:10.088908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2e958-45b0-4bf1-a8cb-dedbaefd63fc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:10.191557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1246/2487] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:10 2022] PUT /identity/v3/projects/c876091609fe45ba80370a16748cbeb2/users/7277aedb35df448e8b3056f8bc395e32/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:10.196632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d035-271e-4d05-b1d9-157a40b91305 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:10.196924 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d035-271e-4d05-b1d9-157a40b91305 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:10.197202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8d035-271e-4d05-b1d9-157a40b91305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:10.214324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7bc8d035-271e-4d05-b1d9-157a40b91305 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:10.215524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7bc8d035-271e-4d05-b1d9-157a40b91305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:10.276627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1242/2488] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:10.286137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2e958-45b0-4bf1-a8cb-dedbaefd63fc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:10.287923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-87f2e958-45b0-4bf1-a8cb-dedbaefd63fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:10.343777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2e958-45b0-4bf1-a8cb-dedbaefd63fc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:10.347638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d39e2c-0506-4181-8261-743ce909897b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:10.348336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d39e2c-0506-4181-8261-743ce909897b service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:10.348619 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d39e2c-0506-4181-8261-743ce909897b service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:10.348898 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d39e2c-0506-4181-8261-743ce909897b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:10.358134 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d39e2c-0506-4181-8261-743ce909897b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:10.360093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d39e2c-0506-4181-8261-743ce909897b service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:10.369221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1247/2489] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:15.803973 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8f7da-e8f0-4b39-87f5-a1458bb3e3de None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:15.804528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8f7da-e8f0-4b39-87f5-a1458bb3e3de None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:15.804528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8f7da-e8f0-4b39-87f5-a1458bb3e3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:15.833920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2be8f7da-e8f0-4b39-87f5-a1458bb3e3de None None] MFA Rules not processed for user `7277aedb35df448e8b3056f8bc395e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:15.835239 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2be8f7da-e8f0-4b39-87f5-a1458bb3e3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:15.877058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:15.910160 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1243/2490] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:53:15.914593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d39e2c-0506-4181-8261-743ce909897b service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:15.924734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d39e2c-0506-4181-8261-743ce909897b service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:15.932512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad812d-6343-451c-bb1a-2bd5047e7511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:15.932512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad812d-6343-451c-bb1a-2bd5047e7511 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:15.932512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad812d-6343-451c-bb1a-2bd5047e7511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:15.938189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad812d-6343-451c-bb1a-2bd5047e7511 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:15.938189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad812d-6343-451c-bb1a-2bd5047e7511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:15.938189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad812d-6343-451c-bb1a-2bd5047e7511 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:16.039098 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1248/2491] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:53:15 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:53:16.042926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8f7da-e8f0-4b39-87f5-a1458bb3e3de None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:16.054284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8f7da-e8f0-4b39-87f5-a1458bb3e3de None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:16.114620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e5821-9ea1-4a1d-9926-11c1c7041970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:16.115441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e5821-9ea1-4a1d-9926-11c1c7041970 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:16.115881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e5821-9ea1-4a1d-9926-11c1c7041970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:16.116248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e5821-9ea1-4a1d-9926-11c1c7041970 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:16.117109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e5821-9ea1-4a1d-9926-11c1c7041970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:16.119525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e5821-9ea1-4a1d-9926-11c1c7041970 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:16.192088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1244/2492] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:53:16 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:16.196007 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad812d-6343-451c-bb1a-2bd5047e7511 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:16.207081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad812d-6343-451c-bb1a-2bd5047e7511 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:16.211873 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3c46b-0e94-4986-b7b3-81910248b651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:16.217524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3c46b-0e94-4986-b7b3-81910248b651 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:16.217524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3c46b-0e94-4986-b7b3-81910248b651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:16.217524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3c46b-0e94-4986-b7b3-81910248b651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:16.217524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3c46b-0e94-4986-b7b3-81910248b651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:16.217524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3c46b-0e94-4986-b7b3-81910248b651 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:16.227025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1249/2493] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:16.231167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e5821-9ea1-4a1d-9926-11c1c7041970 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:16.241257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e5821-9ea1-4a1d-9926-11c1c7041970 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:16.245883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e792b0-4ec8-40c8-b808-4aae742aca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:16.246756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e792b0-4ec8-40c8-b808-4aae742aca31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:16.247038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e792b0-4ec8-40c8-b808-4aae742aca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:16.247315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e792b0-4ec8-40c8-b808-4aae742aca31 admin admin] PATH_INFO: `/v3/projects/9f0fde7fb08644efaba1845b2cbd7a54/users/6a431482ce4c4c11821e90203ddd35e7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:16.262091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e792b0-4ec8-40c8-b808-4aae742aca31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0fde7fb08644efaba1845b2cbd7a54, user_id=6a431482ce4c4c11821e90203ddd35e7, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:16.265227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e792b0-4ec8-40c8-b808-4aae742aca31 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:16.335557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1245/2494] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:16 2022] PUT /identity/v3/projects/9f0fde7fb08644efaba1845b2cbd7a54/users/6a431482ce4c4c11821e90203ddd35e7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:16.339673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3c46b-0e94-4986-b7b3-81910248b651 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:16.351386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3c46b-0e94-4986-b7b3-81910248b651 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:16.411792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f032be4-e15e-472f-8290-573fa4a50c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:16.412459 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032be4-e15e-472f-8290-573fa4a50c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:16.412744 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032be4-e15e-472f-8290-573fa4a50c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:16.413021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f032be4-e15e-472f-8290-573fa4a50c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:16.413792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f032be4-e15e-472f-8290-573fa4a50c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:16.415535 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f032be4-e15e-472f-8290-573fa4a50c51 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:16.428580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1250/2495] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:16.429917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e792b0-4ec8-40c8-b808-4aae742aca31 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:16.441391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e792b0-4ec8-40c8-b808-4aae742aca31 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:16.446227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769e41-f8b6-4b35-949d-a390e7d6964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:16.447885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769e41-f8b6-4b35-949d-a390e7d6964e admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:16.448299 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769e41-f8b6-4b35-949d-a390e7d6964e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:16.448693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54769e41-f8b6-4b35-949d-a390e7d6964e admin admin] PATH_INFO: `/v3/projects/9f0fde7fb08644efaba1845b2cbd7a54/users/6a431482ce4c4c11821e90203ddd35e7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:16.451622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769e41-f8b6-4b35-949d-a390e7d6964e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0fde7fb08644efaba1845b2cbd7a54, user_id=6a431482ce4c4c11821e90203ddd35e7, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:16.456380 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54769e41-f8b6-4b35-949d-a390e7d6964e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:16.475435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1246/2496] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:16 2022] PUT /identity/v3/projects/9f0fde7fb08644efaba1845b2cbd7a54/users/6a431482ce4c4c11821e90203ddd35e7/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:23.050493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de24eb-fd21-4b41-bcc4-5346ef9b195e None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:23.051125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de24eb-fd21-4b41-bcc4-5346ef9b195e None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:23.051125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de24eb-fd21-4b41-bcc4-5346ef9b195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:23.087965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-12de24eb-fd21-4b41-bcc4-5346ef9b195e None None] MFA Rules not processed for user `6a431482ce4c4c11821e90203ddd35e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:23.089274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-12de24eb-fd21-4b41-bcc4-5346ef9b195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:23.132849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:23.177058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1251/2497] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:23.190352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769e41-f8b6-4b35-949d-a390e7d6964e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:23.193302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-54769e41-f8b6-4b35-949d-a390e7d6964e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:23.256452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54769e41-f8b6-4b35-949d-a390e7d6964e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:23.260182 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63ad3d-9992-4948-b5d3-ac236fdeeb86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '079eeefcd0654dfe9cd4a9c51d239298', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:23.260846 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63ad3d-9992-4948-b5d3-ac236fdeeb86 service glance] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:23.261129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63ad3d-9992-4948-b5d3-ac236fdeeb86 service glance] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:23.261413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63ad3d-9992-4948-b5d3-ac236fdeeb86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:23.308397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:23.323836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63ad3d-9992-4948-b5d3-ac236fdeeb86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:23.325277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63ad3d-9992-4948-b5d3-ac236fdeeb86 service glance] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:23.335246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1247/2498] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:23.575244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb181a-d102-4b18-841d-392ea4008b39 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:23.575540 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb181a-d102-4b18-841d-392ea4008b39 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:23.575829 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb181a-d102-4b18-841d-392ea4008b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:23.594391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cddb181a-d102-4b18-841d-392ea4008b39 None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:23.595599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cddb181a-d102-4b18-841d-392ea4008b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:23.652085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1252/2499] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:23.674763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63ad3d-9992-4948-b5d3-ac236fdeeb86 service glance] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:23.676177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0e63ad3d-9992-4948-b5d3-ac236fdeeb86 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:23.748611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63ad3d-9992-4948-b5d3-ac236fdeeb86 service glance] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:23.754198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d5411-250d-496d-906a-9de978a4fb97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:23.754848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5411-250d-496d-906a-9de978a4fb97 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:23.755136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5411-250d-496d-906a-9de978a4fb97 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:23.755413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5411-250d-496d-906a-9de978a4fb97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:23.763416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d5411-250d-496d-906a-9de978a4fb97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:23.765017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d5411-250d-496d-906a-9de978a4fb97 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:23.773036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1248/2500] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:53:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:53:33.645188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=37 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:33.769847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=40 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:35.143023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7f46c-620a-48a8-bdf1-68fb469077b2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:35.143716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7f46c-620a-48a8-bdf1-68fb469077b2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:35.143716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7f46c-620a-48a8-bdf1-68fb469077b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:35.165289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-3aa7f46c-620a-48a8-bdf1-68fb469077b2 None None] MFA Rules not processed for user `7277aedb35df448e8b3056f8bc395e32`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:35.166668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3aa7f46c-620a-48a8-bdf1-68fb469077b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:35.176210 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1253/2501] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:35.237534 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d5411-250d-496d-906a-9de978a4fb97 service swift] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:35.299656 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d5411-250d-496d-906a-9de978a4fb97 service swift] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:35.303630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91b514-0b4d-40c7-aad3-45c7a79d4c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:35.304283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b514-0b4d-40c7-aad3-45c7a79d4c83 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:35.304589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b514-0b4d-40c7-aad3-45c7a79d4c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:35.304866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91b514-0b4d-40c7-aad3-45c7a79d4c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:35.306776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bd91b514-0b4d-40c7-aad3-45c7a79d4c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:35.382488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91b514-0b4d-40c7-aad3-45c7a79d4c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:35.383942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91b514-0b4d-40c7-aad3-45c7a79d4c83 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:35.396600 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1249/2502] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:35.450167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7f46c-620a-48a8-bdf1-68fb469077b2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:35.451575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3aa7f46c-620a-48a8-bdf1-68fb469077b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:35.467806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7f46c-620a-48a8-bdf1-68fb469077b2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:35.471800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08300662-1ec8-4976-9ce6-45db1473ee51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:35.472480 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08300662-1ec8-4976-9ce6-45db1473ee51 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:35.472768 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08300662-1ec8-4976-9ce6-45db1473ee51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:35.473050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08300662-1ec8-4976-9ce6-45db1473ee51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:35.475371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-08300662-1ec8-4976-9ce6-45db1473ee51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:35.486840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08300662-1ec8-4976-9ce6-45db1473ee51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:35.488313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08300662-1ec8-4976-9ce6-45db1473ee51 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:35.497927 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1254/2503] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:39.333288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c7d3-2514-4072-8d7f-8701c8f3e286 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:39.333817 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c7d3-2514-4072-8d7f-8701c8f3e286 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:39.334104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c7d3-2514-4072-8d7f-8701c8f3e286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:39.356861 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b324c7d3-2514-4072-8d7f-8701c8f3e286 None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:39.365130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b324c7d3-2514-4072-8d7f-8701c8f3e286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:39.373271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1250/2504] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:53:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:39.387484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08300662-1ec8-4976-9ce6-45db1473ee51 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:39.400856 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08300662-1ec8-4976-9ce6-45db1473ee51 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:39.406233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b1300-2a4d-4072-8c11-5af5ddaaee3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:39.406895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1300-2a4d-4072-8c11-5af5ddaaee3e service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:39.407185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1300-2a4d-4072-8c11-5af5ddaaee3e service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:39.407467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b1300-2a4d-4072-8c11-5af5ddaaee3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:39.418492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b1300-2a4d-4072-8c11-5af5ddaaee3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:39.420762 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b1300-2a4d-4072-8c11-5af5ddaaee3e service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:39.430293 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1255/2505] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:53:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:53:39.591384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c7d3-2514-4072-8d7f-8701c8f3e286 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:39.602475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c7d3-2514-4072-8d7f-8701c8f3e286 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:39.606595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717490f2-6f47-41d0-87dc-50bd32eee686 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:39.607288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717490f2-6f47-41d0-87dc-50bd32eee686 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:39.608286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717490f2-6f47-41d0-87dc-50bd32eee686 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:39.608726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717490f2-6f47-41d0-87dc-50bd32eee686 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:39.610818 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-717490f2-6f47-41d0-87dc-50bd32eee686 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:39.637803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717490f2-6f47-41d0-87dc-50bd32eee686 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:39.637803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717490f2-6f47-41d0-87dc-50bd32eee686 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:39.648835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1251/2506] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:40.162546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b1300-2a4d-4072-8c11-5af5ddaaee3e service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:40.182303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-326b1300-2a4d-4072-8c11-5af5ddaaee3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:40.191875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b1300-2a4d-4072-8c11-5af5ddaaee3e service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:40.202850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:40.205083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:40.205899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:40.206504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] PATH_INFO: `/v3/users/0537911b91184fcdbdcc9e93ec3fe5b9` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:40.222980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0537911b91184fcdbdcc9e93ec3fe5b9)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:40.226965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:40.649516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0537911b91184fcdbdcc9e93ec3fe5b9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:40.650855 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0537911b91184fcdbdcc9e93ec3fe5b9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:40.763212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0537911b91184fcdbdcc9e93ec3fe5b9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:40.768349 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0537911b91184fcdbdcc9e93ec3fe5b9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:40.788038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ae3dd9a8-ea36-4cc5-84cb-04e5125988c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0537911b91184fcdbdcc9e93ec3fe5b9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:40.847905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1256/2507] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:53:40 2022] DELETE /identity/v3/users/0537911b91184fcdbdcc9e93ec3fe5b9 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:41.383627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717490f2-6f47-41d0-87dc-50bd32eee686 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:41.402623 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717490f2-6f47-41d0-87dc-50bd32eee686 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:41.538775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:41.540536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:41.540825 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:41.541128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] PATH_INFO: `/v3/projects/cad768b45d17480d8d6bbbcff6032c8d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:41.544106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] RBAC: Authorizing `identity:delete_project(project_id=cad768b45d17480d8d6bbbcff6032c8d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:41.546796 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:41.724721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:41.757309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cad768b45d17480d8d6bbbcff6032c8d', 'request_id': 'req-eda75b58-3121-46c8-9635-24de040620de'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:41.775664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cad768b45d17480d8d6bbbcff6032c8d', 'request_id': 'req-eda75b58-3121-46c8-9635-24de040620de'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:41.803527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cad768b45d17480d8d6bbbcff6032c8d', 'request_id': 'req-eda75b58-3121-46c8-9635-24de040620de'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:41.890110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] The token cache is being invalidate because project cad768b45d17480d8d6bbbcff6032c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:53:41.890477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:41.891333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-eda75b58-3121-46c8-9635-24de040620de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:41.894925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1252/2508] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:53:41 2022] DELETE /identity/v3/projects/cad768b45d17480d8d6bbbcff6032c8d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:41.899618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3713e-4d9a-44bf-87d6-42a293e2b720 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:41.900113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3713e-4d9a-44bf-87d6-42a293e2b720 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:41.900194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3713e-4d9a-44bf-87d6-42a293e2b720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:41.952094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e8f3713e-4d9a-44bf-87d6-42a293e2b720 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:41.953569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e8f3713e-4d9a-44bf-87d6-42a293e2b720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:42.178456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1257/2509] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:42.186492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70495fd-df0a-4c4a-a6ba-18495a319d71 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:42.186849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70495fd-df0a-4c4a-a6ba-18495a319d71 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:42.187177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70495fd-df0a-4c4a-a6ba-18495a319d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:42.230440 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-a70495fd-df0a-4c4a-a6ba-18495a319d71 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:42.232106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a70495fd-df0a-4c4a-a6ba-18495a319d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:42.275035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3713e-4d9a-44bf-87d6-42a293e2b720 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:42.276143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1253/2510] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:42.291913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3713e-4d9a-44bf-87d6-42a293e2b720 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:42.325835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5485c-80fb-43e9-912c-3226ecbff69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:42.328211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5485c-80fb-43e9-912c-3226ecbff69a admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:42.328944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5485c-80fb-43e9-912c-3226ecbff69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:42.329448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5485c-80fb-43e9-912c-3226ecbff69a admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:42.330518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5485c-80fb-43e9-912c-3226ecbff69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:53:42.331181 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5485c-80fb-43e9-912c-3226ecbff69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:42.334986 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5485c-80fb-43e9-912c-3226ecbff69a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:42.369378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1258/2511] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:53:42.374264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70495fd-df0a-4c4a-a6ba-18495a319d71 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:42.395842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70495fd-df0a-4c4a-a6ba-18495a319d71 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:42.421006 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582402ad-6ff7-4960-9196-12cf995a45fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:42.421747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582402ad-6ff7-4960-9196-12cf995a45fd admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:42.422070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582402ad-6ff7-4960-9196-12cf995a45fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:42.422314 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582402ad-6ff7-4960-9196-12cf995a45fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:42.423122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582402ad-6ff7-4960-9196-12cf995a45fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:42.426570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582402ad-6ff7-4960-9196-12cf995a45fd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:42.581095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1254/2512] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:53:42 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:42.582114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5485c-80fb-43e9-912c-3226ecbff69a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:42.609851 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5485c-80fb-43e9-912c-3226ecbff69a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:42.709889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:42.785047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0bf9f-c142-4da8-abcd-fab0e78c7a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:42.785828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0bf9f-c142-4da8-abcd-fab0e78c7a5a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:42.786119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0bf9f-c142-4da8-abcd-fab0e78c7a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:42.786379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0bf9f-c142-4da8-abcd-fab0e78c7a5a admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:42.787687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0bf9f-c142-4da8-abcd-fab0e78c7a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:42.795157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b0bf9f-c142-4da8-abcd-fab0e78c7a5a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:42.905528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1259/2513] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:53:42 2022] POST /identity/v3/users => generated 287 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:42.908708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582402ad-6ff7-4960-9196-12cf995a45fd admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:42.926057 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582402ad-6ff7-4960-9196-12cf995a45fd admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:42.951224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9fc32-0a2a-4121-a6ab-e89010e2bb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:42.952866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9fc32-0a2a-4121-a6ab-e89010e2bb38 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:42.953170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9fc32-0a2a-4121-a6ab-e89010e2bb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:42.953508 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9fc32-0a2a-4121-a6ab-e89010e2bb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:42.954384 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9fc32-0a2a-4121-a6ab-e89010e2bb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:42.956204 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9fc32-0a2a-4121-a6ab-e89010e2bb38 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:43.004095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0bf9f-c142-4da8-abcd-fab0e78c7a5a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:43.026172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1255/2514] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:43.029130 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0bf9f-c142-4da8-abcd-fab0e78c7a5a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:43.041931 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ccd94b-bd31-4a51-a380-0583e17a2008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:43.042626 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccd94b-bd31-4a51-a380-0583e17a2008 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:43.043011 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccd94b-bd31-4a51-a380-0583e17a2008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:43.043180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ccd94b-bd31-4a51-a380-0583e17a2008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:43.043982 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccd94b-bd31-4a51-a380-0583e17a2008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:43.046168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ccd94b-bd31-4a51-a380-0583e17a2008 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:43.097184 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9fc32-0a2a-4121-a6ab-e89010e2bb38 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:43.112371 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1260/2515] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:43.116315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9fc32-0a2a-4121-a6ab-e89010e2bb38 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:43.124494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c2177-8c27-4b2e-b61f-8b622a763a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:43.125445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c2177-8c27-4b2e-b61f-8b622a763a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:43.125781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c2177-8c27-4b2e-b61f-8b622a763a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:43.126159 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c2177-8c27-4b2e-b61f-8b622a763a58 admin admin] PATH_INFO: `/v3/projects/650fa64e79474bb0a55fc1ecbcf422ec/users/d86d99b601ce4c67994d3dc5de21eab2/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:43.181937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c2177-8c27-4b2e-b61f-8b622a763a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650fa64e79474bb0a55fc1ecbcf422ec, user_id=d86d99b601ce4c67994d3dc5de21eab2, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:43.193901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515c2177-8c27-4b2e-b61f-8b622a763a58 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:43.391078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1256/2516] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:43 2022] PUT /identity/v3/projects/650fa64e79474bb0a55fc1ecbcf422ec/users/d86d99b601ce4c67994d3dc5de21eab2/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:43.401713 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb14a05-3d27-4713-ad9d-22ba4a45a149 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:43.402350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb14a05-3d27-4713-ad9d-22ba4a45a149 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:43.402882 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb14a05-3d27-4713-ad9d-22ba4a45a149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:43.466271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1fb14a05-3d27-4713-ad9d-22ba4a45a149 None None] MFA Rules not processed for user `d86d99b601ce4c67994d3dc5de21eab2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:43.469332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1fb14a05-3d27-4713-ad9d-22ba4a45a149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:43.619518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c2177-8c27-4b2e-b61f-8b622a763a58 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:43.621376 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1261/2517] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:43.624592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-515c2177-8c27-4b2e-b61f-8b622a763a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:43.843107 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c2177-8c27-4b2e-b61f-8b622a763a58 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:43.858048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da3391-f1a0-415a-96a0-7094a94b6263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:43.859105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da3391-f1a0-415a-96a0-7094a94b6263 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:43.859622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da3391-f1a0-415a-96a0-7094a94b6263 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:43.860108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da3391-f1a0-415a-96a0-7094a94b6263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:43.873507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da3391-f1a0-415a-96a0-7094a94b6263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:43.879505 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da3391-f1a0-415a-96a0-7094a94b6263 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:43.900113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1257/2518] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:44.256561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb14a05-3d27-4713-ad9d-22ba4a45a149 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:44.411218 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb14a05-3d27-4713-ad9d-22ba4a45a149 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:44.421859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:44.424032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:44.424839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:44.425386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] PATH_INFO: `/v3/users/d86d99b601ce4c67994d3dc5de21eab2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:44.429096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86d99b601ce4c67994d3dc5de21eab2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:44.433654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:44.667269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:44.685228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86d99b601ce4c67994d3dc5de21eab2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:44.686081 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86d99b601ce4c67994d3dc5de21eab2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:44.784216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86d99b601ce4c67994d3dc5de21eab2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:44.784935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86d99b601ce4c67994d3dc5de21eab2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:44.809456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86d99b601ce4c67994d3dc5de21eab2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:44.838990 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1262/2519] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:53:44 2022] DELETE /identity/v3/users/d86d99b601ce4c67994d3dc5de21eab2 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:44.845801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b760599-c77e-49a6-865a-274b84db6a1d None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:44.847256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b760599-c77e-49a6-865a-274b84db6a1d None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:44.847716 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b760599-c77e-49a6-865a-274b84db6a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:44.874743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-6b760599-c77e-49a6-865a-274b84db6a1d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:44.876226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6b760599-c77e-49a6-865a-274b84db6a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:44.970116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:45.009355 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1258/2520] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:53:45.028690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:45.030542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:45.136920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a550a-b75a-4494-b156-ba3e864d8dec admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:45.142027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f77159-93fd-45bb-9f56-51c8c72f2ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:45.143058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f77159-93fd-45bb-9f56-51c8c72f2ffe service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:45.143207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f77159-93fd-45bb-9f56-51c8c72f2ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:45.143771 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f77159-93fd-45bb-9f56-51c8c72f2ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:45.156332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f77159-93fd-45bb-9f56-51c8c72f2ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:45.158388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f77159-93fd-45bb-9f56-51c8c72f2ffe service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:45.186939 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1263/2521] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:45.988290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b760599-c77e-49a6-865a-274b84db6a1d None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:45.990925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6b760599-c77e-49a6-865a-274b84db6a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:46.016624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b760599-c77e-49a6-865a-274b84db6a1d None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:46.026029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:46.027351 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:46.027817 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:46.028241 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] PATH_INFO: `/v3/projects/650fa64e79474bb0a55fc1ecbcf422ec` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:46.034098 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=650fa64e79474bb0a55fc1ecbcf422ec)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:46.036674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:46.225070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650fa64e79474bb0a55fc1ecbcf422ec', 'request_id': 'req-cdd7d0cb-778e-461e-8e87-bd724ed58535'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:46.231952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650fa64e79474bb0a55fc1ecbcf422ec', 'request_id': 'req-cdd7d0cb-778e-461e-8e87-bd724ed58535'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:46.242221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650fa64e79474bb0a55fc1ecbcf422ec', 'request_id': 'req-cdd7d0cb-778e-461e-8e87-bd724ed58535'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:46.381325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] The token cache is being invalidate because project 650fa64e79474bb0a55fc1ecbcf422ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:53:46.381757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:46.382691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-cdd7d0cb-778e-461e-8e87-bd724ed58535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:46.391055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984445d2-f6f7-4c2b-879e-843976ce42cd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:46.392162 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984445d2-f6f7-4c2b-879e-843976ce42cd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:46.392667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984445d2-f6f7-4c2b-879e-843976ce42cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:46.401979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1259/2522] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:53:45 2022] DELETE /identity/v3/projects/650fa64e79474bb0a55fc1ecbcf422ec => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:46.414345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-984445d2-f6f7-4c2b-879e-843976ce42cd None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:46.416224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-984445d2-f6f7-4c2b-879e-843976ce42cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:46.499629 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1264/2523] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:46.513714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3988ed-1f70-4af7-87ce-c68feeae0acf None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:46.514877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3988ed-1f70-4af7-87ce-c68feeae0acf None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:46.515342 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3988ed-1f70-4af7-87ce-c68feeae0acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:46.545469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5f3988ed-1f70-4af7-87ce-c68feeae0acf None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:46.546816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5f3988ed-1f70-4af7-87ce-c68feeae0acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:46.556415 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1260/2524] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:46.560414 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984445d2-f6f7-4c2b-879e-843976ce42cd None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:46.579696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984445d2-f6f7-4c2b-879e-843976ce42cd None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:46.586146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36bc7-b4ec-458f-9bf5-a05ad9f6ce5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:46.587083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36bc7-b4ec-458f-9bf5-a05ad9f6ce5d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:46.587437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36bc7-b4ec-458f-9bf5-a05ad9f6ce5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:46.587662 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac36bc7-b4ec-458f-9bf5-a05ad9f6ce5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:46.588411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac36bc7-b4ec-458f-9bf5-a05ad9f6ce5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:53:46.588750 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac36bc7-b4ec-458f-9bf5-a05ad9f6ce5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:46.590560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac36bc7-b4ec-458f-9bf5-a05ad9f6ce5d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:46.616812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1265/2525] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:53:46.618798 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3988ed-1f70-4af7-87ce-c68feeae0acf None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:46.634282 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3988ed-1f70-4af7-87ce-c68feeae0acf None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:46.640257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02acd5-22ef-49f0-a2ac-763757df6902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:46.641658 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02acd5-22ef-49f0-a2ac-763757df6902 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:46.642140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02acd5-22ef-49f0-a2ac-763757df6902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:46.642827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02acd5-22ef-49f0-a2ac-763757df6902 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:46.644041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02acd5-22ef-49f0-a2ac-763757df6902 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:46.647043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce02acd5-22ef-49f0-a2ac-763757df6902 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:46.671040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36bc7-b4ec-458f-9bf5-a05ad9f6ce5d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:46.673072 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dac36bc7-b4ec-458f-9bf5-a05ad9f6ce5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:46.698878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac36bc7-b4ec-458f-9bf5-a05ad9f6ce5d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:46.706192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:46.707100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:46.714432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:46.714432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] PATH_INFO: `/v3/users/1e83db01f0b24204a61b037b3c1f044c` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:46.714432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e83db01f0b24204a61b037b3c1f044c)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:46.714432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:46.787243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1261/2526] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:53:46 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:46.788292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02acd5-22ef-49f0-a2ac-763757df6902 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:46.882585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02acd5-22ef-49f0-a2ac-763757df6902 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:46.891170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a518a03-537e-4a3f-bf81-b1ebdfff94c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:46.891872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518a03-537e-4a3f-bf81-b1ebdfff94c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:46.892162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518a03-537e-4a3f-bf81-b1ebdfff94c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:46.892445 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a518a03-537e-4a3f-bf81-b1ebdfff94c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:46.893149 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a518a03-537e-4a3f-bf81-b1ebdfff94c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:46.895256 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a518a03-537e-4a3f-bf81-b1ebdfff94c7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:46.964604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:46.981755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e83db01f0b24204a61b037b3c1f044c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:46.982745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e83db01f0b24204a61b037b3c1f044c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:46.989954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1262/2527] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:53:46 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:53:46.991375 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a518a03-537e-4a3f-bf81-b1ebdfff94c7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:46.993091 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6a518a03-537e-4a3f-bf81-b1ebdfff94c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:47.015018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a518a03-537e-4a3f-bf81-b1ebdfff94c7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:47.031413 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3773ad-0459-4393-9d5b-8312010bf281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:47.032360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3773ad-0459-4393-9d5b-8312010bf281 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:47.032725 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3773ad-0459-4393-9d5b-8312010bf281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:47.033114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3773ad-0459-4393-9d5b-8312010bf281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:47.033915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3773ad-0459-4393-9d5b-8312010bf281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:47.036648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3773ad-0459-4393-9d5b-8312010bf281 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:47.070854 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1263/2528] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:47.072038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3773ad-0459-4393-9d5b-8312010bf281 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:47.082551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e83db01f0b24204a61b037b3c1f044c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:47.084460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e83db01f0b24204a61b037b3c1f044c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:47.093890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3773ad-0459-4393-9d5b-8312010bf281 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:47.100177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9eff8-80c9-457e-a986-0e716eafcbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:47.100849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9eff8-80c9-457e-a986-0e716eafcbb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:47.103254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e83db01f0b24204a61b037b3c1f044c'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:47.103389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9eff8-80c9-457e-a986-0e716eafcbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:47.103389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9eff8-80c9-457e-a986-0e716eafcbb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:47.103389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9eff8-80c9-457e-a986-0e716eafcbb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:47.104201 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9eff8-80c9-457e-a986-0e716eafcbb7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:47.117889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1266/2529] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:53:46 2022] DELETE /identity/v3/users/1e83db01f0b24204a61b037b3c1f044c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:47.131476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1264/2530] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:47.138316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:47.245052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215dae22-af22-4e95-b415-dc7753a18dab admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:47.252991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54406aa3-4e4f-4a70-8098-71afaaa6677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:47.254308 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54406aa3-4e4f-4a70-8098-71afaaa6677e admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:47.254581 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54406aa3-4e4f-4a70-8098-71afaaa6677e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:47.254938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54406aa3-4e4f-4a70-8098-71afaaa6677e admin admin] PATH_INFO: `/v3/projects/cb2d497531ee4995ba22405a5ae1e5d5/users/6478c1303ad24b6bbbf197f3329b9e13/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:47.272745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54406aa3-4e4f-4a70-8098-71afaaa6677e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2d497531ee4995ba22405a5ae1e5d5, user_id=6478c1303ad24b6bbbf197f3329b9e13, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:47.275659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54406aa3-4e4f-4a70-8098-71afaaa6677e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:47.380834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1267/2531] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:47 2022] PUT /identity/v3/projects/cb2d497531ee4995ba22405a5ae1e5d5/users/6478c1303ad24b6bbbf197f3329b9e13/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:47.399269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87d623-2131-49f5-b57e-576777934a5a None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:47.399784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87d623-2131-49f5-b57e-576777934a5a None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:47.400134 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87d623-2131-49f5-b57e-576777934a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:47.410035 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:47.434759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54406aa3-4e4f-4a70-8098-71afaaa6677e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:47.437833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-dc87d623-2131-49f5-b57e-576777934a5a None None] MFA Rules not processed for user `6478c1303ad24b6bbbf197f3329b9e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:47.438270 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-54406aa3-4e4f-4a70-8098-71afaaa6677e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:47.439152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-dc87d623-2131-49f5-b57e-576777934a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:47.553122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1265/2532] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:47.557967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87d623-2131-49f5-b57e-576777934a5a None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:47.562745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54406aa3-4e4f-4a70-8098-71afaaa6677e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:47.568863 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:47.569962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:47.570329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:47.570659 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] PATH_INFO: `/v3/projects/a90e7edce8984d49b7bdebed2947b436` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:47.572265 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a90e7edce8984d49b7bdebed2947b436)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:47.573175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87d623-2131-49f5-b57e-576777934a5a None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:47.574560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:47.579674 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188c21-a734-4efc-899d-ab2c0ebf0971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:47.580441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188c21-a734-4efc-899d-ab2c0ebf0971 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:47.580799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188c21-a734-4efc-899d-ab2c0ebf0971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:47.581155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61188c21-a734-4efc-899d-ab2c0ebf0971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:47.581967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61188c21-a734-4efc-899d-ab2c0ebf0971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:47.584748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61188c21-a734-4efc-899d-ab2c0ebf0971 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:48.608128 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1266/2533] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:53:47 2022] POST /identity/v3/projects => generated 363 bytes in 1051 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:53:48.610406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:48.612141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188c21-a734-4efc-899d-ab2c0ebf0971 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:48.618015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90e7edce8984d49b7bdebed2947b436', 'request_id': 'req-7175355a-7e41-4824-9661-ac1fbfa1e542'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:48.627486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90e7edce8984d49b7bdebed2947b436', 'request_id': 'req-7175355a-7e41-4824-9661-ac1fbfa1e542'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:48.635420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90e7edce8984d49b7bdebed2947b436', 'request_id': 'req-7175355a-7e41-4824-9661-ac1fbfa1e542'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:48.681498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61188c21-a734-4efc-899d-ab2c0ebf0971 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:48.686682 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d2dd5-cacb-4694-a5ec-b67ba3e30958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:48.687449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2dd5-cacb-4694-a5ec-b67ba3e30958 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:48.687739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2dd5-cacb-4694-a5ec-b67ba3e30958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:48.688042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2dd5-cacb-4694-a5ec-b67ba3e30958 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:48.688767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d2dd5-cacb-4694-a5ec-b67ba3e30958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:48.690806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d2dd5-cacb-4694-a5ec-b67ba3e30958 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:48.749385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] The token cache is being invalidate because project a90e7edce8984d49b7bdebed2947b436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:53:48.749767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:48.750347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-7175355a-7e41-4824-9661-ac1fbfa1e542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:48.752096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1268/2534] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:53:47 2022] DELETE /identity/v3/projects/a90e7edce8984d49b7bdebed2947b436 => generated 0 bytes in 1318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:48.757004 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e65e4-c427-4e76-9c13-fc43791e6b57 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:48.757374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e65e4-c427-4e76-9c13-fc43791e6b57 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:48.757678 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e65e4-c427-4e76-9c13-fc43791e6b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:48.778773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1267/2535] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:53:48 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:48.784944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d2dd5-cacb-4694-a5ec-b67ba3e30958 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:48.787015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-922d2dd5-cacb-4694-a5ec-b67ba3e30958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:48.787169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f91e65e4-c427-4e76-9c13-fc43791e6b57 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:48.788405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f91e65e4-c427-4e76-9c13-fc43791e6b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:48.799012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1269/2536] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:53:48.801022 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d2dd5-cacb-4694-a5ec-b67ba3e30958 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:48.805880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83c2ee-35ea-442d-909f-41926ac48360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:48.806436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015838fd-44f1-4eb6-987b-a80e5f3add18 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:48.806746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015838fd-44f1-4eb6-987b-a80e5f3add18 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:48.806863 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83c2ee-35ea-442d-909f-41926ac48360 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:48.807030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015838fd-44f1-4eb6-987b-a80e5f3add18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:48.807303 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83c2ee-35ea-442d-909f-41926ac48360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:48.807676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83c2ee-35ea-442d-909f-41926ac48360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:48.808405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83c2ee-35ea-442d-909f-41926ac48360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:48.810031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83c2ee-35ea-442d-909f-41926ac48360 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:48.824340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1268/2537] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:53:48.825341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83c2ee-35ea-442d-909f-41926ac48360 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:48.825727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-015838fd-44f1-4eb6-987b-a80e5f3add18 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:48.832321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-015838fd-44f1-4eb6-987b-a80e5f3add18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:48.835131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83c2ee-35ea-442d-909f-41926ac48360 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:48.835534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1270/2538] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:53:48.840512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015838fd-44f1-4eb6-987b-a80e5f3add18 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:48.844649 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f2ff2-e5d0-42f8-9ca5-0405ee47d700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:48.845659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f2ff2-e5d0-42f8-9ca5-0405ee47d700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:48.845856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f2ff2-e5d0-42f8-9ca5-0405ee47d700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:48.846494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f2ff2-e5d0-42f8-9ca5-0405ee47d700 admin admin] PATH_INFO: `/v3/projects/15a10dcc65ee4ecd8be6e9af9b7fb711/users/2b4f3af34f304cb0bedc1ea54af2ba29/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:48.851498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015838fd-44f1-4eb6-987b-a80e5f3add18 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:48.856163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8390-5b04-49f0-8fa1-6fcb3b4bc8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:48.856850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8390-5b04-49f0-8fa1-6fcb3b4bc8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:48.857138 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8390-5b04-49f0-8fa1-6fcb3b4bc8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:48.857431 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c8390-5b04-49f0-8fa1-6fcb3b4bc8cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:48.858773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c8390-5b04-49f0-8fa1-6fcb3b4bc8cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:53:48.859084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c8390-5b04-49f0-8fa1-6fcb3b4bc8cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:48.860719 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c8390-5b04-49f0-8fa1-6fcb3b4bc8cc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:48.864096 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f2ff2-e5d0-42f8-9ca5-0405ee47d700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a10dcc65ee4ecd8be6e9af9b7fb711, user_id=2b4f3af34f304cb0bedc1ea54af2ba29, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:48.867840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f2ff2-e5d0-42f8-9ca5-0405ee47d700 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:48.872302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1271/2539] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:53:48.876649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8390-5b04-49f0-8fa1-6fcb3b4bc8cc admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:48.887382 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c8390-5b04-49f0-8fa1-6fcb3b4bc8cc admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:48.893524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7a2bd-5da3-432d-aa2d-45f660b37fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:48.894520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7a2bd-5da3-432d-aa2d-45f660b37fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:48.894903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7a2bd-5da3-432d-aa2d-45f660b37fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:48.895185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7a2bd-5da3-432d-aa2d-45f660b37fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:48.895907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7a2bd-5da3-432d-aa2d-45f660b37fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:48.897874 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7a2bd-5da3-432d-aa2d-45f660b37fcd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:49.002739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1269/2540] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:48 2022] PUT /identity/v3/projects/15a10dcc65ee4ecd8be6e9af9b7fb711/users/2b4f3af34f304cb0bedc1ea54af2ba29/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:49.007006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1272/2541] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:53:48 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:53:49.007180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f2ff2-e5d0-42f8-9ca5-0405ee47d700 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:49.008340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7a2bd-5da3-432d-aa2d-45f660b37fcd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:49.070469 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f2ff2-e5d0-42f8-9ca5-0405ee47d700 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:49.071129 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7a2bd-5da3-432d-aa2d-45f660b37fcd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:49.076916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb077b7-29a5-43a4-9a8d-369ab38ecac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:49.077117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef657e1-a1f2-4ae4-af4d-dd2f71865905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:49.077343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb077b7-29a5-43a4-9a8d-369ab38ecac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:49.077627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb077b7-29a5-43a4-9a8d-369ab38ecac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:49.080841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef657e1-a1f2-4ae4-af4d-dd2f71865905 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:49.081137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb077b7-29a5-43a4-9a8d-369ab38ecac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:49.081228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef657e1-a1f2-4ae4-af4d-dd2f71865905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:49.081228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef657e1-a1f2-4ae4-af4d-dd2f71865905 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:49.081393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb077b7-29a5-43a4-9a8d-369ab38ecac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:49.081476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef657e1-a1f2-4ae4-af4d-dd2f71865905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:49.081561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb077b7-29a5-43a4-9a8d-369ab38ecac6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:49.081642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef657e1-a1f2-4ae4-af4d-dd2f71865905 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:49.093733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1270/2542] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:53:49.097126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb077b7-29a5-43a4-9a8d-369ab38ecac6 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:49.107177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb077b7-29a5-43a4-9a8d-369ab38ecac6 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:49.112000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd0c0f-a2f7-477a-815f-fe9f0474222c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:49.112867 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd0c0f-a2f7-477a-815f-fe9f0474222c admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:49.113154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd0c0f-a2f7-477a-815f-fe9f0474222c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:49.113452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd0c0f-a2f7-477a-815f-fe9f0474222c admin admin] PATH_INFO: `/v3/projects/15a10dcc65ee4ecd8be6e9af9b7fb711/users/2b4f3af34f304cb0bedc1ea54af2ba29/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:49.115523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd0c0f-a2f7-477a-815f-fe9f0474222c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a10dcc65ee4ecd8be6e9af9b7fb711, user_id=2b4f3af34f304cb0bedc1ea54af2ba29, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:49.118203 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd0c0f-a2f7-477a-815f-fe9f0474222c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:49.128490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1271/2543] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:49 2022] PUT /identity/v3/projects/15a10dcc65ee4ecd8be6e9af9b7fb711/users/2b4f3af34f304cb0bedc1ea54af2ba29/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:53:49.138595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03b6d8-8d6d-4297-93b5-bb6f53f3d3d7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:49.139425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03b6d8-8d6d-4297-93b5-bb6f53f3d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:49.139712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03b6d8-8d6d-4297-93b5-bb6f53f3d3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:49.167818 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-fc03b6d8-8d6d-4297-93b5-bb6f53f3d3d7 None None] MFA Rules not processed for user `2b4f3af34f304cb0bedc1ea54af2ba29`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:49.169039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fc03b6d8-8d6d-4297-93b5-bb6f53f3d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:49.217605 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1273/2544] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:53:49 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:49.218687 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef657e1-a1f2-4ae4-af4d-dd2f71865905 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:49.230604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef657e1-a1f2-4ae4-af4d-dd2f71865905 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:49.235253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:49.246169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1272/2545] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:49 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:53:49.257763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03b6d8-8d6d-4297-93b5-bb6f53f3d3d7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:49.259588 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fc03b6d8-8d6d-4297-93b5-bb6f53f3d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:49.289958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e9722-2afa-4a0c-a80c-a99e3d49c070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:49.290500 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e9722-2afa-4a0c-a80c-a99e3d49c070 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:49.290786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e9722-2afa-4a0c-a80c-a99e3d49c070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:49.291063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e9722-2afa-4a0c-a80c-a99e3d49c070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:49.292231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e9722-2afa-4a0c-a80c-a99e3d49c070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:49.293894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e9722-2afa-4a0c-a80c-a99e3d49c070 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:49.304472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1274/2546] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:53:49.318003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03b6d8-8d6d-4297-93b5-bb6f53f3d3d7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:49.319515 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e9722-2afa-4a0c-a80c-a99e3d49c070 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:49.321527 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414b50e-9a41-470d-bd28-59d0bdb8e7f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:49.322121 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414b50e-9a41-470d-bd28-59d0bdb8e7f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:49.322411 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414b50e-9a41-470d-bd28-59d0bdb8e7f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:49.322694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414b50e-9a41-470d-bd28-59d0bdb8e7f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:49.330484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e9722-2afa-4a0c-a80c-a99e3d49c070 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:49.335794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414b50e-9a41-470d-bd28-59d0bdb8e7f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:49.336091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da78649-358d-4339-9b64-1258f2736862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:49.336666 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da78649-358d-4339-9b64-1258f2736862 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:49.336948 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da78649-358d-4339-9b64-1258f2736862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:49.337223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da78649-358d-4339-9b64-1258f2736862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:49.337476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414b50e-9a41-470d-bd28-59d0bdb8e7f5 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:49.337983 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da78649-358d-4339-9b64-1258f2736862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:49.339671 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da78649-358d-4339-9b64-1258f2736862 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:49.348487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1273/2547] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:49 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:53:49.355203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1275/2548] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:53:49.358465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414b50e-9a41-470d-bd28-59d0bdb8e7f5 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:49.369168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414b50e-9a41-470d-bd28-59d0bdb8e7f5 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:49.374812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06d65-0353-46a1-936a-224828539702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:49.375705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06d65-0353-46a1-936a-224828539702 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:49.375993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06d65-0353-46a1-936a-224828539702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:49.376319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde06d65-0353-46a1-936a-224828539702 admin admin] PATH_INFO: `/v3/projects/cbe580a28eae4195be1491ac29d373a7/users/aa52505a079041efbbf14fb04da7ac7f/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:49.392834 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde06d65-0353-46a1-936a-224828539702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe580a28eae4195be1491ac29d373a7, user_id=aa52505a079041efbbf14fb04da7ac7f, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:49.395564 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde06d65-0353-46a1-936a-224828539702 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:49.554894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1274/2549] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:49 2022] PUT /identity/v3/projects/cbe580a28eae4195be1491ac29d373a7/users/aa52505a079041efbbf14fb04da7ac7f/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:49.564746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ccb2-6587-4a9c-acb5-aee590c6e7c8 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:49.565034 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ccb2-6587-4a9c-acb5-aee590c6e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:49.565336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ccb2-6587-4a9c-acb5-aee590c6e7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:49.583118 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e3a8ccb2-6587-4a9c-acb5-aee590c6e7c8 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:49.584451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e3a8ccb2-6587-4a9c-acb5-aee590c6e7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:49.644539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1276/2550] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:49.654227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06d65-0353-46a1-936a-224828539702 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:49.656100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-bde06d65-0353-46a1-936a-224828539702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:49.718369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde06d65-0353-46a1-936a-224828539702 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:49.722320 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882d9e6-1b46-4ec0-a50b-13b45f478b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:49.722972 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882d9e6-1b46-4ec0-a50b-13b45f478b3b service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:49.723257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882d9e6-1b46-4ec0-a50b-13b45f478b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:49.723536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882d9e6-1b46-4ec0-a50b-13b45f478b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:49.732776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882d9e6-1b46-4ec0-a50b-13b45f478b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:49.734253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882d9e6-1b46-4ec0-a50b-13b45f478b3b service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:49.743736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1275/2551] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:50.020315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:50.141194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:50.505027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8ccb2-6587-4a9c-acb5-aee590c6e7c8 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:50.515325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8ccb2-6587-4a9c-acb5-aee590c6e7c8 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:50.520966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:50.521879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:50.522168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:50.522486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] PATH_INFO: `/v3/users/6478c1303ad24b6bbbf197f3329b9e13` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:50.523681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6478c1303ad24b6bbbf197f3329b9e13)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:50.525634 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:50.768533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6478c1303ad24b6bbbf197f3329b9e13'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:50.769206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6478c1303ad24b6bbbf197f3329b9e13'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:50.905156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6478c1303ad24b6bbbf197f3329b9e13'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:50.905919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6478c1303ad24b6bbbf197f3329b9e13'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:50.918809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6478c1303ad24b6bbbf197f3329b9e13'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:50.930946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1277/2552] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:53:50 2022] DELETE /identity/v3/users/6478c1303ad24b6bbbf197f3329b9e13 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:50.936060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246517d-1d22-448e-a57a-f270edc4430b None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:50.936918 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246517d-1d22-448e-a57a-f270edc4430b None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:50.937380 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246517d-1d22-448e-a57a-f270edc4430b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:50.956013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7246517d-1d22-448e-a57a-f270edc4430b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:50.965973 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7246517d-1d22-448e-a57a-f270edc4430b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:51.017358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1276/2553] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:51.027085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:51.028488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:51.086799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996b2be-d947-4385-bdda-bd9951e89f77 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:51.091593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba01bfc-3e29-471b-b781-a051b641c5f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:51.092289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba01bfc-3e29-471b-b781-a051b641c5f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:51.092575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba01bfc-3e29-471b-b781-a051b641c5f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:51.092850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba01bfc-3e29-471b-b781-a051b641c5f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:51.105249 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba01bfc-3e29-471b-b781-a051b641c5f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:51.106731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba01bfc-3e29-471b-b781-a051b641c5f3 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:51.116375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1278/2554] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:51.642144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246517d-1d22-448e-a57a-f270edc4430b None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:51.643789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7246517d-1d22-448e-a57a-f270edc4430b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:51.677306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246517d-1d22-448e-a57a-f270edc4430b None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:51.683817 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:51.684786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:51.685071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:51.685348 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] PATH_INFO: `/v3/projects/cb2d497531ee4995ba22405a5ae1e5d5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:51.687511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2d497531ee4995ba22405a5ae1e5d5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:51.689434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:51.897162 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2d497531ee4995ba22405a5ae1e5d5', 'request_id': 'req-9c3fc943-d9f8-45a0-813b-286da85ef7ae'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:51.907558 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2d497531ee4995ba22405a5ae1e5d5', 'request_id': 'req-9c3fc943-d9f8-45a0-813b-286da85ef7ae'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:51.916432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2d497531ee4995ba22405a5ae1e5d5', 'request_id': 'req-9c3fc943-d9f8-45a0-813b-286da85ef7ae'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:52.025012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] The token cache is being invalidate because project cb2d497531ee4995ba22405a5ae1e5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:53:52.025749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:52.026102 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:52.027662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1277/2555] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:53:51 2022] DELETE /identity/v3/projects/cb2d497531ee4995ba22405a5ae1e5d5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:53:52.032303 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba01bfc-3e29-471b-b781-a051b641c5f3 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:52.042136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba01bfc-3e29-471b-b781-a051b641c5f3 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:52.050787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:52.110583 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:52.111681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:52.112038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:52.112393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] PATH_INFO: `/v3/users/2b4f3af34f304cb0bedc1ea54af2ba29` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:52.113711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b4f3af34f304cb0bedc1ea54af2ba29)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:52.116061 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:52.426107 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b4f3af34f304cb0bedc1ea54af2ba29'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:52.427140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b4f3af34f304cb0bedc1ea54af2ba29'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:52.528194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b4f3af34f304cb0bedc1ea54af2ba29'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:52.528826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b4f3af34f304cb0bedc1ea54af2ba29'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:52.541711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3d386e51-0a3d-4a66-83cf-c088d2372081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b4f3af34f304cb0bedc1ea54af2ba29'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:52.554560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1279/2556] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:53:52 2022] DELETE /identity/v3/users/2b4f3af34f304cb0bedc1ea54af2ba29 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:53.238343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:53.239949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:53.254423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fc943-d9f8-45a0-813b-286da85ef7ae admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:53.299618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:53.322354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:53.323233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:53.323525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:53.323811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] PATH_INFO: `/v3/projects/15a10dcc65ee4ecd8be6e9af9b7fb711` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:53.325217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a10dcc65ee4ecd8be6e9af9b7fb711)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:53.327190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:53.458523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a10dcc65ee4ecd8be6e9af9b7fb711', 'request_id': 'req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:53.464949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a10dcc65ee4ecd8be6e9af9b7fb711', 'request_id': 'req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:53.472288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a10dcc65ee4ecd8be6e9af9b7fb711', 'request_id': 'req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:53.561866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] The token cache is being invalidate because project 15a10dcc65ee4ecd8be6e9af9b7fb711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:53:53.566283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:53.566283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8c9ef9da-a16f-4275-9875-ef8ea9c731b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:53:53.566283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1278/2557] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:53:53 2022] DELETE /identity/v3/projects/15a10dcc65ee4ecd8be6e9af9b7fb711 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:53:53.570100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424c5b-6268-471e-95c1-32ba4906bd3b None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:53.570583 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424c5b-6268-471e-95c1-32ba4906bd3b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:53.570793 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5424c5b-6268-471e-95c1-32ba4906bd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:53.588930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b5424c5b-6268-471e-95c1-32ba4906bd3b None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:53.590216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b5424c5b-6268-471e-95c1-32ba4906bd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:53.656975 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1280/2558] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:53.667170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de3fa-02d8-4159-8978-24ecc9850d34 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:53.667738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de3fa-02d8-4159-8978-24ecc9850d34 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:53.668332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773de3fa-02d8-4159-8978-24ecc9850d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:53.689837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-773de3fa-02d8-4159-8978-24ecc9850d34 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:53.693246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-773de3fa-02d8-4159-8978-24ecc9850d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:53.700949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1279/2559] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:53.705087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5424c5b-6268-471e-95c1-32ba4906bd3b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:53.717041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5424c5b-6268-471e-95c1-32ba4906bd3b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:53.722847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c6f83-8829-4594-bf20-f62eb57177a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:53.723596 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c6f83-8829-4594-bf20-f62eb57177a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:53.723962 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c6f83-8829-4594-bf20-f62eb57177a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:53.724320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c6f83-8829-4594-bf20-f62eb57177a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:53.725128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c6f83-8829-4594-bf20-f62eb57177a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:53:53.725696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c6f83-8829-4594-bf20-f62eb57177a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:53.727405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c6f83-8829-4594-bf20-f62eb57177a0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:53.765905 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1281/2560] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:53:53.770922 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773de3fa-02d8-4159-8978-24ecc9850d34 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:53.780373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773de3fa-02d8-4159-8978-24ecc9850d34 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:53.785200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e0ce-ac63-40a7-9e0d-c60e6229f6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:53.785907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e0ce-ac63-40a7-9e0d-c60e6229f6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:53.786194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e0ce-ac63-40a7-9e0d-c60e6229f6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:53.786671 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459e0ce-ac63-40a7-9e0d-c60e6229f6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:53.787372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459e0ce-ac63-40a7-9e0d-c60e6229f6e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:53.789304 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459e0ce-ac63-40a7-9e0d-c60e6229f6e0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:53.881431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1280/2561] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:53:53 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:53.882654 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c6f83-8829-4594-bf20-f62eb57177a0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:53.893887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c6f83-8829-4594-bf20-f62eb57177a0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:53.910924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:53.960041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421b22d-2c97-486c-9f32-502fc61b247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:53.961055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421b22d-2c97-486c-9f32-502fc61b247f admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:53.962055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421b22d-2c97-486c-9f32-502fc61b247f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:53.962055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421b22d-2c97-486c-9f32-502fc61b247f admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:53.962794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421b22d-2c97-486c-9f32-502fc61b247f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:53.965140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421b22d-2c97-486c-9f32-502fc61b247f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:54.037338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1282/2562] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:53:53 2022] POST /identity/v3/users => generated 282 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:54.042644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e0ce-ac63-40a7-9e0d-c60e6229f6e0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:54.054234 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459e0ce-ac63-40a7-9e0d-c60e6229f6e0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:54.059313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c45d35-9018-4d3c-b3b0-e8b0653af65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:54.060078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c45d35-9018-4d3c-b3b0-e8b0653af65f admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:54.061108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c45d35-9018-4d3c-b3b0-e8b0653af65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:54.061464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c45d35-9018-4d3c-b3b0-e8b0653af65f admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:54.062236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c45d35-9018-4d3c-b3b0-e8b0653af65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:54.063945 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c45d35-9018-4d3c-b3b0-e8b0653af65f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:54.085349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1281/2563] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:54.089353 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421b22d-2c97-486c-9f32-502fc61b247f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:54.102672 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421b22d-2c97-486c-9f32-502fc61b247f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:54.108051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56015e7-68dc-43bc-836a-ae2106e97fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:54.108812 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56015e7-68dc-43bc-836a-ae2106e97fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:54.109168 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56015e7-68dc-43bc-836a-ae2106e97fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:54.109515 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56015e7-68dc-43bc-836a-ae2106e97fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:54.110476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56015e7-68dc-43bc-836a-ae2106e97fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:54.112238 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56015e7-68dc-43bc-836a-ae2106e97fbd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:54.128615 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1283/2564] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:54.129948 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c45d35-9018-4d3c-b3b0-e8b0653af65f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:54.141550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c45d35-9018-4d3c-b3b0-e8b0653af65f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:54.147850 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9f96e-6dd7-4c04-b887-a589e25d511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:54.149657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9f96e-6dd7-4c04-b887-a589e25d511c admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:54.149995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9f96e-6dd7-4c04-b887-a589e25d511c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:54.150288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9f96e-6dd7-4c04-b887-a589e25d511c admin admin] PATH_INFO: `/v3/projects/3acc5ff3014045ca8b45791c4d7a0ae2/users/fc3af5a1c562445d8c0c9ef9e28a36cb/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:54.174829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9f96e-6dd7-4c04-b887-a589e25d511c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acc5ff3014045ca8b45791c4d7a0ae2, user_id=fc3af5a1c562445d8c0c9ef9e28a36cb, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:54.178262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9f96e-6dd7-4c04-b887-a589e25d511c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:54.301338 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1282/2565] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:54 2022] PUT /identity/v3/projects/3acc5ff3014045ca8b45791c4d7a0ae2/users/fc3af5a1c562445d8c0c9ef9e28a36cb/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:54.312418 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2670eb-17bf-40a2-b9f1-9b5bfc125eee None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:54.313192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2670eb-17bf-40a2-b9f1-9b5bfc125eee None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:54.313708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2670eb-17bf-40a2-b9f1-9b5bfc125eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:54.363338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7f2670eb-17bf-40a2-b9f1-9b5bfc125eee None None] MFA Rules not processed for user `fc3af5a1c562445d8c0c9ef9e28a36cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:54.364590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7f2670eb-17bf-40a2-b9f1-9b5bfc125eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:54.434313 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1284/2566] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:54.435521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9f96e-6dd7-4c04-b887-a589e25d511c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:54.540031 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9f96e-6dd7-4c04-b887-a589e25d511c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:54.548626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83066c89-17ee-4b75-981d-0fd4925b1bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:54.549391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83066c89-17ee-4b75-981d-0fd4925b1bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:54.549777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83066c89-17ee-4b75-981d-0fd4925b1bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:54.550545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83066c89-17ee-4b75-981d-0fd4925b1bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:54.550886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83066c89-17ee-4b75-981d-0fd4925b1bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:54.553284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83066c89-17ee-4b75-981d-0fd4925b1bc9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:54.568504 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:54.705752 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1283/2567] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:53:54 2022] POST /identity/v3/projects => generated 365 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:53:54.709488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2670eb-17bf-40a2-b9f1-9b5bfc125eee None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:54.730599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2670eb-17bf-40a2-b9f1-9b5bfc125eee None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:54.860492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db8719-2e22-43bc-86f4-fa8273260253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:54.868173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db8719-2e22-43bc-86f4-fa8273260253 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:54.868173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db8719-2e22-43bc-86f4-fa8273260253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:54.868173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db8719-2e22-43bc-86f4-fa8273260253 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:54.868173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db8719-2e22-43bc-86f4-fa8273260253 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:54.868173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db8719-2e22-43bc-86f4-fa8273260253 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:54.980999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1285/2568] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:53:54 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:53:54.985542 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83066c89-17ee-4b75-981d-0fd4925b1bc9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:55.001158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83066c89-17ee-4b75-981d-0fd4925b1bc9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:55.010075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545d1f-48d9-438d-b7aa-7573132429ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:55.010823 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545d1f-48d9-438d-b7aa-7573132429ab admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:55.011117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545d1f-48d9-438d-b7aa-7573132429ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:55.011442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545d1f-48d9-438d-b7aa-7573132429ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:55.012284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5545d1f-48d9-438d-b7aa-7573132429ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:55.014884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5545d1f-48d9-438d-b7aa-7573132429ab admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:55.030897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1284/2569] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:55.034220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db8719-2e22-43bc-86f4-fa8273260253 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:55.048673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db8719-2e22-43bc-86f4-fa8273260253 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:55.056469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435004a-5bd0-4ab2-8da3-5f542c414f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:55.058283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435004a-5bd0-4ab2-8da3-5f542c414f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:55.058767 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435004a-5bd0-4ab2-8da3-5f542c414f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:55.059274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435004a-5bd0-4ab2-8da3-5f542c414f82 admin admin] PATH_INFO: `/v3/projects/6ec3559e1e984afeb72692a8e6b0e697/users/f9881ee3303f4d9e9dee7ea0d703d4dc/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:55.092676 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435004a-5bd0-4ab2-8da3-5f542c414f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec3559e1e984afeb72692a8e6b0e697, user_id=f9881ee3303f4d9e9dee7ea0d703d4dc, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:55.097869 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435004a-5bd0-4ab2-8da3-5f542c414f82 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:55.183147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1286/2570] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:55 2022] PUT /identity/v3/projects/6ec3559e1e984afeb72692a8e6b0e697/users/f9881ee3303f4d9e9dee7ea0d703d4dc/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:55.184810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545d1f-48d9-438d-b7aa-7573132429ab admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:55.196005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545d1f-48d9-438d-b7aa-7573132429ab admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:55.230508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:55.264576 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b90fe3-3616-4d87-81a3-074f47186ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:55.265257 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b90fe3-3616-4d87-81a3-074f47186ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:55.265547 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b90fe3-3616-4d87-81a3-074f47186ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:55.265883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b90fe3-3616-4d87-81a3-074f47186ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:55.266621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b90fe3-3616-4d87-81a3-074f47186ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:55.268225 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b90fe3-3616-4d87-81a3-074f47186ed4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:55.279284 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1285/2571] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:53:55.284178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435004a-5bd0-4ab2-8da3-5f542c414f82 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:55.295179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435004a-5bd0-4ab2-8da3-5f542c414f82 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:55.299926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b84ba-fcb3-496e-a07c-f5c1749795f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:55.300799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b84ba-fcb3-496e-a07c-f5c1749795f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:55.301080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b84ba-fcb3-496e-a07c-f5c1749795f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:55.301484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b84ba-fcb3-496e-a07c-f5c1749795f5 admin admin] PATH_INFO: `/v3/projects/6ec3559e1e984afeb72692a8e6b0e697/users/f9881ee3303f4d9e9dee7ea0d703d4dc/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:55.303568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b84ba-fcb3-496e-a07c-f5c1749795f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec3559e1e984afeb72692a8e6b0e697, user_id=f9881ee3303f4d9e9dee7ea0d703d4dc, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:55.306277 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b84ba-fcb3-496e-a07c-f5c1749795f5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:55.317322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1287/2572] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:53:55 2022] PUT /identity/v3/projects/6ec3559e1e984afeb72692a8e6b0e697/users/f9881ee3303f4d9e9dee7ea0d703d4dc/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:53:55.329233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d7c23-5cb5-4f55-a1d3-d2f70b9cc425 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:55.329872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d7c23-5cb5-4f55-a1d3-d2f70b9cc425 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:55.329872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d7c23-5cb5-4f55-a1d3-d2f70b9cc425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:55.359559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-124d7c23-5cb5-4f55-a1d3-d2f70b9cc425 None None] MFA Rules not processed for user `f9881ee3303f4d9e9dee7ea0d703d4dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:55.361240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-124d7c23-5cb5-4f55-a1d3-d2f70b9cc425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:55.489000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1286/2573] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:55.502086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b84ba-fcb3-496e-a07c-f5c1749795f5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:55.504256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f07b84ba-fcb3-496e-a07c-f5c1749795f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:55.598047 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b84ba-fcb3-496e-a07c-f5c1749795f5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:55.602924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f66aaa-4fe1-42b8-aad8-72b8fd7233a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:55.603627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f66aaa-4fe1-42b8-aad8-72b8fd7233a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:55.604056 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f66aaa-4fe1-42b8-aad8-72b8fd7233a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:55.604338 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f66aaa-4fe1-42b8-aad8-72b8fd7233a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:55.615443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f66aaa-4fe1-42b8-aad8-72b8fd7233a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:55.617102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f66aaa-4fe1-42b8-aad8-72b8fd7233a8 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:55.628082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1288/2574] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:55.892198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d7c23-5cb5-4f55-a1d3-d2f70b9cc425 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:55.904332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d7c23-5cb5-4f55-a1d3-d2f70b9cc425 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:55.912475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8dfbd-1cc3-4452-b381-2c8488cb5f9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:55.912475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8dfbd-1cc3-4452-b381-2c8488cb5f9e service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:55.912475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8dfbd-1cc3-4452-b381-2c8488cb5f9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:55.912475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8dfbd-1cc3-4452-b381-2c8488cb5f9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:55.981122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8dfbd-1cc3-4452-b381-2c8488cb5f9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:55.983093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8dfbd-1cc3-4452-b381-2c8488cb5f9e service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:56.004098 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1287/2575] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:56.108309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0319b-0104-4eb6-95da-1b688b9dcc88 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:56.108830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0319b-0104-4eb6-95da-1b688b9dcc88 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:56.108830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0319b-0104-4eb6-95da-1b688b9dcc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:56.137928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-37c0319b-0104-4eb6-95da-1b688b9dcc88 None None] MFA Rules not processed for user `aa52505a079041efbbf14fb04da7ac7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:56.139857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-37c0319b-0104-4eb6-95da-1b688b9dcc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:56.208407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1289/2576] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:56.213111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:56.233931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8dfbd-1cc3-4452-b381-2c8488cb5f9e service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:56.235342 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-38a8dfbd-1cc3-4452-b381-2c8488cb5f9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:56.308274 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8dfbd-1cc3-4452-b381-2c8488cb5f9e service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:56.313936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a5ab0-c732-4343-ba20-13cef83161ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:56.314589 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a5ab0-c732-4343-ba20-13cef83161ee service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:56.314873 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a5ab0-c732-4343-ba20-13cef83161ee service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:56.315151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a5ab0-c732-4343-ba20-13cef83161ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:56.323884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a5ab0-c732-4343-ba20-13cef83161ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:56.325490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a5ab0-c732-4343-ba20-13cef83161ee service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:56.334765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1288/2577] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:53:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:59.392128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf84ea-e296-4716-8c89-5085ecb4b5c7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:59.393166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf84ea-e296-4716-8c89-5085ecb4b5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:59.394077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf84ea-e296-4716-8c89-5085ecb4b5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:59.418060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9aaf84ea-e296-4716-8c89-5085ecb4b5c7 None None] MFA Rules not processed for user `aa52505a079041efbbf14fb04da7ac7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:59.419435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9aaf84ea-e296-4716-8c89-5085ecb4b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:59.430522 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1290/2578] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:05.667120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d249a52-4101-43b6-9834-e404b0476282 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:05.672278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d249a52-4101-43b6-9834-e404b0476282 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:05.672278 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d249a52-4101-43b6-9834-e404b0476282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:05.689696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4d249a52-4101-43b6-9834-e404b0476282 None None] MFA Rules not processed for user `b47d51863b0448b880dc03b01dec6dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:05.691447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4d249a52-4101-43b6-9834-e404b0476282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:05.768507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1289/2579] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:06.318089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf84ea-e296-4716-8c89-5085ecb4b5c7 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:06.319824 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9aaf84ea-e296-4716-8c89-5085ecb4b5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:06.379275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf84ea-e296-4716-8c89-5085ecb4b5c7 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:06.383525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392cd6-9cd1-429f-a2ac-1193bd1ca211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:06.384290 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392cd6-9cd1-429f-a2ac-1193bd1ca211 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:06.385015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392cd6-9cd1-429f-a2ac-1193bd1ca211 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:06.385015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392cd6-9cd1-429f-a2ac-1193bd1ca211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:06.386991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-83392cd6-9cd1-429f-a2ac-1193bd1ca211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:06.398009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83392cd6-9cd1-429f-a2ac-1193bd1ca211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:06.399465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83392cd6-9cd1-429f-a2ac-1193bd1ca211 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:06.409188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1291/2580] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:09.389749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d249a52-4101-43b6-9834-e404b0476282 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:09.461073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d249a52-4101-43b6-9834-e404b0476282 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:09.465892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:09.466766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:09.467054 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:09.467336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] PATH_INFO: `/v3/users/fc3af5a1c562445d8c0c9ef9e28a36cb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:09.469214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc3af5a1c562445d8c0c9ef9e28a36cb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:09.471447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:09.744122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392cd6-9cd1-429f-a2ac-1193bd1ca211 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:09.745516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-83392cd6-9cd1-429f-a2ac-1193bd1ca211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:09.755784 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:09.808075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:09.820004 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392cd6-9cd1-429f-a2ac-1193bd1ca211 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:09.826671 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39a866-7686-419d-b198-d589837f5079 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:09.827465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39a866-7686-419d-b198-d589837f5079 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:09.827848 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39a866-7686-419d-b198-d589837f5079 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:09.828716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39a866-7686-419d-b198-d589837f5079 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:09.831625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8d39a866-7686-419d-b198-d589837f5079 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:09.832975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc3af5a1c562445d8c0c9ef9e28a36cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:09.845828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39a866-7686-419d-b198-d589837f5079 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:09.847691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39a866-7686-419d-b198-d589837f5079 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:09.859936 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1292/2581] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:09.908866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc3af5a1c562445d8c0c9ef9e28a36cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:09.909727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc3af5a1c562445d8c0c9ef9e28a36cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:09.910611 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc3af5a1c562445d8c0c9ef9e28a36cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:09.939335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc3af5a1c562445d8c0c9ef9e28a36cb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:09.957625 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1290/2582] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:54:09 2022] DELETE /identity/v3/users/fc3af5a1c562445d8c0c9ef9e28a36cb => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:09.960970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1083ed-6ecc-42af-90ef-a6027c91f4c4 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:09.961259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1083ed-6ecc-42af-90ef-a6027c91f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:09.961538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1083ed-6ecc-42af-90ef-a6027c91f4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:09.979452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-ad1083ed-6ecc-42af-90ef-a6027c91f4c4 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:09.981239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ad1083ed-6ecc-42af-90ef-a6027c91f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:10.048551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1293/2583] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:10.058364 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:10.059816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:10.127279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febd172-c609-4f52-91dd-8d4c50b93ace admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:10.131531 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30329c-301a-4f69-85f2-80da1457457b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:10.132201 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30329c-301a-4f69-85f2-80da1457457b service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:10.132492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30329c-301a-4f69-85f2-80da1457457b service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:10.132778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30329c-301a-4f69-85f2-80da1457457b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:10.143925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30329c-301a-4f69-85f2-80da1457457b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:10.146144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30329c-301a-4f69-85f2-80da1457457b service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:10.157631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1291/2584] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:10.551384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1083ed-6ecc-42af-90ef-a6027c91f4c4 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:10.552870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ad1083ed-6ecc-42af-90ef-a6027c91f4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:10.568781 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1083ed-6ecc-42af-90ef-a6027c91f4c4 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:10.606711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:10.607607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:10.608191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:10.608573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] PATH_INFO: `/v3/projects/3acc5ff3014045ca8b45791c4d7a0ae2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:10.613732 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3acc5ff3014045ca8b45791c4d7a0ae2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:10.614226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:10.728874 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3acc5ff3014045ca8b45791c4d7a0ae2', 'request_id': 'req-8804e68b-609e-4be4-be63-c68738610e18'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:10.734866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3acc5ff3014045ca8b45791c4d7a0ae2', 'request_id': 'req-8804e68b-609e-4be4-be63-c68738610e18'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:10.740992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3acc5ff3014045ca8b45791c4d7a0ae2', 'request_id': 'req-8804e68b-609e-4be4-be63-c68738610e18'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:10.818390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] The token cache is being invalidate because project 3acc5ff3014045ca8b45791c4d7a0ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:10.819045 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:10.819249 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:10.820819 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1294/2585] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:54:10 2022] DELETE /identity/v3/projects/3acc5ff3014045ca8b45791c4d7a0ae2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:10.825058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30329c-301a-4f69-85f2-80da1457457b service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:10.835104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30329c-301a-4f69-85f2-80da1457457b service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:10.891292 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:10.892177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:10.892459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:10.892739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] PATH_INFO: `/v3/users/f9881ee3303f4d9e9dee7ea0d703d4dc` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:10.893950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9881ee3303f4d9e9dee7ea0d703d4dc)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:10.895857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:11.155586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9881ee3303f4d9e9dee7ea0d703d4dc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:11.240690 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9881ee3303f4d9e9dee7ea0d703d4dc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:11.240826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9881ee3303f4d9e9dee7ea0d703d4dc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:11.241443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9881ee3303f4d9e9dee7ea0d703d4dc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:11.243033 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:11.255545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-ee4e3f1e-8b26-46d8-a3fb-09f4a22570ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9881ee3303f4d9e9dee7ea0d703d4dc'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:11.268789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1292/2586] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:54:10 2022] DELETE /identity/v3/users/f9881ee3303f4d9e9dee7ea0d703d4dc => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:11.735091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:11.736580 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:11.751369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804e68b-609e-4be4-be63-c68738610e18 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:11.771899 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:11.816369 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:11.817647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:11.817647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:11.818043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] PATH_INFO: `/v3/projects/6ec3559e1e984afeb72692a8e6b0e697` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:11.819307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec3559e1e984afeb72692a8e6b0e697)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:11.821280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:11.934870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec3559e1e984afeb72692a8e6b0e697', 'request_id': 'req-65d387d8-e10e-4728-a63e-1620343fa92b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:11.940619 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec3559e1e984afeb72692a8e6b0e697', 'request_id': 'req-65d387d8-e10e-4728-a63e-1620343fa92b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:11.948661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec3559e1e984afeb72692a8e6b0e697', 'request_id': 'req-65d387d8-e10e-4728-a63e-1620343fa92b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:12.055566 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] The token cache is being invalidate because project 6ec3559e1e984afeb72692a8e6b0e697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:12.056066 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:12.066318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-65d387d8-e10e-4728-a63e-1620343fa92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:12.068658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1295/2587] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:54:11 2022] DELETE /identity/v3/projects/6ec3559e1e984afeb72692a8e6b0e697 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:12.074577 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f0e10-a6b1-4399-af13-0f81c62799bc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:12.075088 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f0e10-a6b1-4399-af13-0f81c62799bc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:12.075226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f0e10-a6b1-4399-af13-0f81c62799bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:12.106291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-440f0e10-a6b1-4399-af13-0f81c62799bc None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:12.108231 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-440f0e10-a6b1-4399-af13-0f81c62799bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:12.206542 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1293/2588] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:12.214387 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8ead-fc5c-48f5-ad54-31be48d6b59d None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:12.214675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8ead-fc5c-48f5-ad54-31be48d6b59d None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:12.214949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8ead-fc5c-48f5-ad54-31be48d6b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:12.240302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-8a5f8ead-fc5c-48f5-ad54-31be48d6b59d None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:12.241747 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8a5f8ead-fc5c-48f5-ad54-31be48d6b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:12.251051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1296/2589] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:12.255687 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f0e10-a6b1-4399-af13-0f81c62799bc None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:12.269422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f0e10-a6b1-4399-af13-0f81c62799bc None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:12.282001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25e105-c870-4c68-aaa5-a825ec4631de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:12.282668 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25e105-c870-4c68-aaa5-a825ec4631de admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:12.282955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25e105-c870-4c68-aaa5-a825ec4631de admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:12.283236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25e105-c870-4c68-aaa5-a825ec4631de admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:12.283982 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25e105-c870-4c68-aaa5-a825ec4631de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:12.284698 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25e105-c870-4c68-aaa5-a825ec4631de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:12.291473 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25e105-c870-4c68-aaa5-a825ec4631de admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:12.308724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f8ead-fc5c-48f5-ad54-31be48d6b59d None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:12.321395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f8ead-fc5c-48f5-ad54-31be48d6b59d None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:12.322390 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1294/2590] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:54:12.326960 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b92bca-163e-4570-b549-a89983c7ecb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:12.327628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b92bca-163e-4570-b549-a89983c7ecb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:12.328475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b92bca-163e-4570-b549-a89983c7ecb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:12.328748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b92bca-163e-4570-b549-a89983c7ecb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:12.329796 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b92bca-163e-4570-b549-a89983c7ecb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:12.332765 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b92bca-163e-4570-b549-a89983c7ecb1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:12.492314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1297/2591] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:54:12 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:12.494313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25e105-c870-4c68-aaa5-a825ec4631de admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:12.504401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25e105-c870-4c68-aaa5-a825ec4631de admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:12.596361 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b92bca-163e-4570-b549-a89983c7ecb1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:12.598543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-99b92bca-163e-4570-b549-a89983c7ecb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:12.610017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646472a3-5294-4284-b046-b63b4886c746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:12.610886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646472a3-5294-4284-b046-b63b4886c746 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:12.611362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646472a3-5294-4284-b046-b63b4886c746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:12.611660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646472a3-5294-4284-b046-b63b4886c746 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:12.612419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646472a3-5294-4284-b046-b63b4886c746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:12.615321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646472a3-5294-4284-b046-b63b4886c746 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:12.667374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b92bca-163e-4570-b549-a89983c7ecb1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:12.671210 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c72925-f640-44f5-944f-6adddf280008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:12.672013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c72925-f640-44f5-944f-6adddf280008 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:12.672302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c72925-f640-44f5-944f-6adddf280008 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:12.672586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c72925-f640-44f5-944f-6adddf280008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:12.674472 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a7c72925-f640-44f5-944f-6adddf280008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:12.743612 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1295/2592] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:54:12 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:12.744558 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646472a3-5294-4284-b046-b63b4886c746 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:12.750520 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c72925-f640-44f5-944f-6adddf280008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:12.752639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c72925-f640-44f5-944f-6adddf280008 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:12.757061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646472a3-5294-4284-b046-b63b4886c746 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:12.763745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b622ff-c641-404f-958f-b56567762c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:12.764419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b622ff-c641-404f-958f-b56567762c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:12.764704 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b622ff-c641-404f-958f-b56567762c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:12.764976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b622ff-c641-404f-958f-b56567762c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:12.766480 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b622ff-c641-404f-958f-b56567762c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:12.768073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b622ff-c641-404f-958f-b56567762c06 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:12.772657 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1298/2593] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:54:12.782077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1296/2594] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:12.784665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c72925-f640-44f5-944f-6adddf280008 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:12.801188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c72925-f640-44f5-944f-6adddf280008 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:12.806513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486b7c6-a1a4-464e-93f7-d6d46c7ccb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:12.810692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b7c6-a1a4-464e-93f7-d6d46c7ccb8e admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:12.810692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b7c6-a1a4-464e-93f7-d6d46c7ccb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:12.810692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486b7c6-a1a4-464e-93f7-d6d46c7ccb8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:12.810692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486b7c6-a1a4-464e-93f7-d6d46c7ccb8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:12.810692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486b7c6-a1a4-464e-93f7-d6d46c7ccb8e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:12.822683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1299/2595] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:12.827020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b622ff-c641-404f-958f-b56567762c06 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:12.837890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b622ff-c641-404f-958f-b56567762c06 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:12.846638 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987499b-16e3-4086-a4ba-b4593b621d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:12.847628 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987499b-16e3-4086-a4ba-b4593b621d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:12.847980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987499b-16e3-4086-a4ba-b4593b621d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:12.848416 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987499b-16e3-4086-a4ba-b4593b621d1c admin admin] PATH_INFO: `/v3/projects/1c45dc0ba7c74fc7be5e8d0819bbb896/users/536042909165451897ce8b42769b9e60/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:12.866899 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987499b-16e3-4086-a4ba-b4593b621d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c45dc0ba7c74fc7be5e8d0819bbb896, user_id=536042909165451897ce8b42769b9e60, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:12.870573 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987499b-16e3-4086-a4ba-b4593b621d1c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:12.992627 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1297/2596] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:54:12 2022] PUT /identity/v3/projects/1c45dc0ba7c74fc7be5e8d0819bbb896/users/536042909165451897ce8b42769b9e60/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:13.003696 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4082-29dd-4a90-bab5-122c42b6bfbb None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:13.003989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4082-29dd-4a90-bab5-122c42b6bfbb None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:13.004572 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef4082-29dd-4a90-bab5-122c42b6bfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:13.032264 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-54ef4082-29dd-4a90-bab5-122c42b6bfbb None None] MFA Rules not processed for user `536042909165451897ce8b42769b9e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:13.033512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-54ef4082-29dd-4a90-bab5-122c42b6bfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:13.064669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:13.120194 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1300/2597] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:54:13.124492 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987499b-16e3-4086-a4ba-b4593b621d1c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:13.148926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:13.198424 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987499b-16e3-4086-a4ba-b4593b621d1c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:13.203521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37224b34-002b-4934-8648-22f168e6ec40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:13.204870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37224b34-002b-4934-8648-22f168e6ec40 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:13.204870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37224b34-002b-4934-8648-22f168e6ec40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:13.204870 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37224b34-002b-4934-8648-22f168e6ec40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:13.205624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37224b34-002b-4934-8648-22f168e6ec40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:13.207584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37224b34-002b-4934-8648-22f168e6ec40 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:13.294289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1298/2598] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:54:13 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:54:13.298822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef4082-29dd-4a90-bab5-122c42b6bfbb None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:13.318837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef4082-29dd-4a90-bab5-122c42b6bfbb None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:13.398955 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c62d3-2245-482e-9ead-d5901197f64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:13.401522 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c62d3-2245-482e-9ead-d5901197f64a admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:13.402987 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c62d3-2245-482e-9ead-d5901197f64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:13.403463 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c62d3-2245-482e-9ead-d5901197f64a admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:13.404878 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c62d3-2245-482e-9ead-d5901197f64a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:13.409281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c62d3-2245-482e-9ead-d5901197f64a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:13.530469 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1301/2599] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:54:13 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:13.534973 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37224b34-002b-4934-8648-22f168e6ec40 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:13.559279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37224b34-002b-4934-8648-22f168e6ec40 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:13.567354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e77e0-1228-4aa3-94ef-3c02922e5843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:13.568045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e77e0-1228-4aa3-94ef-3c02922e5843 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:13.568327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e77e0-1228-4aa3-94ef-3c02922e5843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:13.568604 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e77e0-1228-4aa3-94ef-3c02922e5843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:13.569340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e77e0-1228-4aa3-94ef-3c02922e5843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:13.570984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e77e0-1228-4aa3-94ef-3c02922e5843 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:13.585849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1299/2600] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:54:13.589195 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c62d3-2245-482e-9ead-d5901197f64a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:13.601836 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c62d3-2245-482e-9ead-d5901197f64a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:13.608210 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bd451-d10e-49fb-bdde-541c5daa018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:13.608890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd451-d10e-49fb-bdde-541c5daa018d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:13.609887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd451-d10e-49fb-bdde-541c5daa018d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:13.610237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bd451-d10e-49fb-bdde-541c5daa018d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:13.610996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bd451-d10e-49fb-bdde-541c5daa018d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:13.612811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bd451-d10e-49fb-bdde-541c5daa018d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:13.631415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1302/2601] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:13.636068 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e77e0-1228-4aa3-94ef-3c02922e5843 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:13.646478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e77e0-1228-4aa3-94ef-3c02922e5843 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:13.651804 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63bdea-88e1-4fc6-85ed-cfa9c92ff6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:13.652126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63bdea-88e1-4fc6-85ed-cfa9c92ff6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:13.652419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63bdea-88e1-4fc6-85ed-cfa9c92ff6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:13.652697 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63bdea-88e1-4fc6-85ed-cfa9c92ff6f8 admin admin] PATH_INFO: `/v3/projects/faac425ae4634518b2104882854bb814/users/9e2df37b44604c04846cee367af41351/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:13.674066 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63bdea-88e1-4fc6-85ed-cfa9c92ff6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faac425ae4634518b2104882854bb814, user_id=9e2df37b44604c04846cee367af41351, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:13.676979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c63bdea-88e1-4fc6-85ed-cfa9c92ff6f8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:13.761156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1300/2602] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:54:13 2022] PUT /identity/v3/projects/faac425ae4634518b2104882854bb814/users/9e2df37b44604c04846cee367af41351/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:13.773256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561016-1121-4e06-af01-a6949315ae10 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:13.773543 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561016-1121-4e06-af01-a6949315ae10 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:13.773867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24561016-1121-4e06-af01-a6949315ae10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:13.805060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-24561016-1121-4e06-af01-a6949315ae10 None None] MFA Rules not processed for user `9e2df37b44604c04846cee367af41351`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:13.806487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-24561016-1121-4e06-af01-a6949315ae10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:13.899570 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1303/2603] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:13.903949 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63bdea-88e1-4fc6-85ed-cfa9c92ff6f8 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:13.975507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63bdea-88e1-4fc6-85ed-cfa9c92ff6f8 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:13.980961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e804ea-5149-495e-b49a-1310c21e784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:13.981712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e804ea-5149-495e-b49a-1310c21e784c admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:13.983515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e804ea-5149-495e-b49a-1310c21e784c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:13.983515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e804ea-5149-495e-b49a-1310c21e784c admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:13.983515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e804ea-5149-495e-b49a-1310c21e784c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:13.984940 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e804ea-5149-495e-b49a-1310c21e784c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:14.103221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1301/2604] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:54:13 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:14.104315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561016-1121-4e06-af01-a6949315ae10 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:14.114643 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24561016-1121-4e06-af01-a6949315ae10 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:14.171587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dab18d-1cfc-44b3-8a4e-ff2ee6825af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:14.172271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dab18d-1cfc-44b3-8a4e-ff2ee6825af4 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:14.172556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dab18d-1cfc-44b3-8a4e-ff2ee6825af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:14.172837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dab18d-1cfc-44b3-8a4e-ff2ee6825af4 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:14.173539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dab18d-1cfc-44b3-8a4e-ff2ee6825af4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:14.175499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dab18d-1cfc-44b3-8a4e-ff2ee6825af4 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:14.294538 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1304/2605] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:54:14 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:14.298784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e804ea-5149-495e-b49a-1310c21e784c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:14.309466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e804ea-5149-495e-b49a-1310c21e784c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:14.314755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb756d2-197e-4aa3-b06a-e2f4ed83b39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:14.315422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb756d2-197e-4aa3-b06a-e2f4ed83b39b admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:14.315709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb756d2-197e-4aa3-b06a-e2f4ed83b39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:14.315985 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb756d2-197e-4aa3-b06a-e2f4ed83b39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:14.316708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb756d2-197e-4aa3-b06a-e2f4ed83b39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:14.318367 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb756d2-197e-4aa3-b06a-e2f4ed83b39b admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:14.330151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1302/2606] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:14.334400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dab18d-1cfc-44b3-8a4e-ff2ee6825af4 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:14.345524 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dab18d-1cfc-44b3-8a4e-ff2ee6825af4 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:14.348004 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:14.355202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817e41-471e-4257-ac60-a1ec9ca1d9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:14.357046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817e41-471e-4257-ac60-a1ec9ca1d9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:14.357422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817e41-471e-4257-ac60-a1ec9ca1d9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:14.357736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817e41-471e-4257-ac60-a1ec9ca1d9c5 admin admin] PATH_INFO: `/v3/projects/473bfdbc69274707a8ab2857e62f7cc3/users/ae25b92c46454f81a0f2860ccbaebdb2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:14.380241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817e41-471e-4257-ac60-a1ec9ca1d9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473bfdbc69274707a8ab2857e62f7cc3, user_id=ae25b92c46454f81a0f2860ccbaebdb2, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:14.382953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817e41-471e-4257-ac60-a1ec9ca1d9c5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:14.524583 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1305/2607] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:54:14 2022] PUT /identity/v3/projects/473bfdbc69274707a8ab2857e62f7cc3/users/ae25b92c46454f81a0f2860ccbaebdb2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:14.525362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb756d2-197e-4aa3-b06a-e2f4ed83b39b admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:14.535684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb756d2-197e-4aa3-b06a-e2f4ed83b39b admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:14.582012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:14.607028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8955cea-ddaf-4efd-9f0d-e9ee4d32b93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:14.607767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8955cea-ddaf-4efd-9f0d-e9ee4d32b93d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:14.608062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8955cea-ddaf-4efd-9f0d-e9ee4d32b93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:14.608344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8955cea-ddaf-4efd-9f0d-e9ee4d32b93d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:14.609814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8955cea-ddaf-4efd-9f0d-e9ee4d32b93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:14.611806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8955cea-ddaf-4efd-9f0d-e9ee4d32b93d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:14.629413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817e41-471e-4257-ac60-a1ec9ca1d9c5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:14.630334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1303/2608] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:54:14.644404 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817e41-471e-4257-ac60-a1ec9ca1d9c5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:14.652406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e74b63-3f4f-46ac-b278-13256b88e849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:14.653745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e74b63-3f4f-46ac-b278-13256b88e849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:14.654039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e74b63-3f4f-46ac-b278-13256b88e849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:14.654498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e74b63-3f4f-46ac-b278-13256b88e849 admin admin] PATH_INFO: `/v3/projects/473bfdbc69274707a8ab2857e62f7cc3/users/ae25b92c46454f81a0f2860ccbaebdb2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:14.656977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e74b63-3f4f-46ac-b278-13256b88e849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473bfdbc69274707a8ab2857e62f7cc3, user_id=ae25b92c46454f81a0f2860ccbaebdb2, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:14.660324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e74b63-3f4f-46ac-b278-13256b88e849 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:14.685779 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1306/2609] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:54:14 2022] PUT /identity/v3/projects/473bfdbc69274707a8ab2857e62f7cc3/users/ae25b92c46454f81a0f2860ccbaebdb2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:14.689131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2a26-ace0-4170-8e70-ecc1a8f623d7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:14.689428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2a26-ace0-4170-8e70-ecc1a8f623d7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:14.689749 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d2a26-ace0-4170-8e70-ecc1a8f623d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:14.728964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4b2d2a26-ace0-4170-8e70-ecc1a8f623d7 None None] MFA Rules not processed for user `ae25b92c46454f81a0f2860ccbaebdb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:14.730478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4b2d2a26-ace0-4170-8e70-ecc1a8f623d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:14.822082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1304/2610] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:14.835874 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e74b63-3f4f-46ac-b278-13256b88e849 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:14.838795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-08e74b63-3f4f-46ac-b278-13256b88e849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:14.912329 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e74b63-3f4f-46ac-b278-13256b88e849 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:14.916362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa0acf-963e-4bb2-b322-9631ccb4857a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:14.917361 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0acf-963e-4bb2-b322-9631ccb4857a service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:14.919288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0acf-963e-4bb2-b322-9631ccb4857a service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:14.919288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa0acf-963e-4bb2-b322-9631ccb4857a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:14.939070 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa0acf-963e-4bb2-b322-9631ccb4857a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:14.957142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa0acf-963e-4bb2-b322-9631ccb4857a service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:14.971774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1307/2611] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:16.356101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2a26-ace0-4170-8e70-ecc1a8f623d7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:16.357877 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4b2d2a26-ace0-4170-8e70-ecc1a8f623d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:16.372522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d2a26-ace0-4170-8e70-ecc1a8f623d7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:16.377180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08f93d-20ce-4e51-afaa-5033a794f77c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:16.378075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f93d-20ce-4e51-afaa-5033a794f77c service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:16.379060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f93d-20ce-4e51-afaa-5033a794f77c service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:16.379584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08f93d-20ce-4e51-afaa-5033a794f77c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:16.467488 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08f93d-20ce-4e51-afaa-5033a794f77c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:16.469462 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08f93d-20ce-4e51-afaa-5033a794f77c service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:16.479003 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1305/2612] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:21.568317 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa0acf-963e-4bb2-b322-9631ccb4857a service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:21.577164 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa0acf-963e-4bb2-b322-9631ccb4857a service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:21.581356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84edcb2-a4e0-4096-87d0-b4f50b44e652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:21.582050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84edcb2-a4e0-4096-87d0-b4f50b44e652 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:21.586402 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84edcb2-a4e0-4096-87d0-b4f50b44e652 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:21.586402 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84edcb2-a4e0-4096-87d0-b4f50b44e652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:21.591759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:21.639759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84edcb2-a4e0-4096-87d0-b4f50b44e652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:21.641879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84edcb2-a4e0-4096-87d0-b4f50b44e652 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:21.650592 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1308/2613] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:25.799147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08f93d-20ce-4e51-afaa-5033a794f77c service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:25.860173 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:25.864894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08f93d-20ce-4e51-afaa-5033a794f77c service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:25.869759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:25.875778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:25.875778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:25.875778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] PATH_INFO: `/v3/users/536042909165451897ce8b42769b9e60` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:25.875778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=536042909165451897ce8b42769b9e60)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:25.875778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:26.136009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536042909165451897ce8b42769b9e60'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:26.230349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536042909165451897ce8b42769b9e60'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:26.230962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536042909165451897ce8b42769b9e60'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:26.231575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536042909165451897ce8b42769b9e60'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:26.244141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536042909165451897ce8b42769b9e60'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:26.257369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1306/2614] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:54:25 2022] DELETE /identity/v3/users/536042909165451897ce8b42769b9e60 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:26.262833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862577ff-999e-4d78-8047-02b3a7bd4acc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.263352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862577ff-999e-4d78-8047-02b3a7bd4acc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.263548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862577ff-999e-4d78-8047-02b3a7bd4acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.281837 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-862577ff-999e-4d78-8047-02b3a7bd4acc None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:26.283054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-862577ff-999e-4d78-8047-02b3a7bd4acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:26.343025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1309/2615] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:26.352961 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:26.354474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:26.411793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3ed5c-1ab4-4fbc-95d3-711c1b03f200 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:26.415562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477c86-06ca-475c-a170-3ab4793e09f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:26.416213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477c86-06ca-475c-a170-3ab4793e09f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.416498 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477c86-06ca-475c-a170-3ab4793e09f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.416784 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f477c86-06ca-475c-a170-3ab4793e09f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.426195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f477c86-06ca-475c-a170-3ab4793e09f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:26.427606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f477c86-06ca-475c-a170-3ab4793e09f7 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:26.438728 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1307/2616] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:54:26.898411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862577ff-999e-4d78-8047-02b3a7bd4acc None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:26.899854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-862577ff-999e-4d78-8047-02b3a7bd4acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:26.916037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862577ff-999e-4d78-8047-02b3a7bd4acc None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:26.922363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:26.923157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:26.923486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:26.923698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] PATH_INFO: `/v3/projects/1c45dc0ba7c74fc7be5e8d0819bbb896` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:26.925165 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c45dc0ba7c74fc7be5e8d0819bbb896)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:26.929731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.081420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c45dc0ba7c74fc7be5e8d0819bbb896', 'request_id': 'req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:27.087254 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c45dc0ba7c74fc7be5e8d0819bbb896', 'request_id': 'req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:27.094600 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c45dc0ba7c74fc7be5e8d0819bbb896', 'request_id': 'req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:27.208746 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] The token cache is being invalidate because project 1c45dc0ba7c74fc7be5e8d0819bbb896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:27.209042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:27.209735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:27.211536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1310/2617] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:54:26 2022] DELETE /identity/v3/projects/1c45dc0ba7c74fc7be5e8d0819bbb896 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:27.215442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477c86-06ca-475c-a170-3ab4793e09f7 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:27.226457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f477c86-06ca-475c-a170-3ab4793e09f7 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:27.287327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:27.288208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:27.288500 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:27.288993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] PATH_INFO: `/v3/users/9e2df37b44604c04846cee367af41351` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:27.290159 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e2df37b44604c04846cee367af41351)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:27.292076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:27.316131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:27.562142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e2df37b44604c04846cee367af41351'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:27.640253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e2df37b44604c04846cee367af41351'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:27.640887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e2df37b44604c04846cee367af41351'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:27.642166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e2df37b44604c04846cee367af41351'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:27.656033 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e2df37b44604c04846cee367af41351'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:27.668835 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1308/2618] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:54:27 2022] DELETE /identity/v3/users/9e2df37b44604c04846cee367af41351 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:28.229934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:28.231492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:28.250321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf681c01-aafd-4995-ac83-f4c87f2fc9a3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:28.299160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:28.338032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:28.338478 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:28.338768 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:28.339054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] PATH_INFO: `/v3/projects/faac425ae4634518b2104882854bb814` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:28.340360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=faac425ae4634518b2104882854bb814)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:28.342356 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:28.481140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faac425ae4634518b2104882854bb814', 'request_id': 'req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:28.487140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faac425ae4634518b2104882854bb814', 'request_id': 'req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:28.494154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faac425ae4634518b2104882854bb814', 'request_id': 'req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:28.600504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] The token cache is being invalidate because project faac425ae4634518b2104882854bb814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:28.600887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:28.601388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:28.602980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1311/2619] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:54:28 2022] DELETE /identity/v3/projects/faac425ae4634518b2104882854bb814 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:28.607224 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:28.608736 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:28.621980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18ec7-0ebd-44dc-bea6-346a89e39770 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:28.682363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:28.683247 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:28.683536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:28.683820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] PATH_INFO: `/v3/users/ae25b92c46454f81a0f2860ccbaebdb2` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:28.685039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae25b92c46454f81a0f2860ccbaebdb2)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:28.687011 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:28.898999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae25b92c46454f81a0f2860ccbaebdb2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:28.982608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae25b92c46454f81a0f2860ccbaebdb2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:28.983487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae25b92c46454f81a0f2860ccbaebdb2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:28.984169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae25b92c46454f81a0f2860ccbaebdb2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:28.996962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-14eb38ea-b559-47cb-b3fd-3230d3cb8954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae25b92c46454f81a0f2860ccbaebdb2'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:29.009915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1309/2620] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:54:28 2022] DELETE /identity/v3/users/ae25b92c46454f81a0f2860ccbaebdb2 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:29.551518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:29.554487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:29.587347 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21a4f4-cd58-407a-9103-1ff55e3d0aee admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:29.650685 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:29.653980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:29.653980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:29.653980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] PATH_INFO: `/v3/projects/473bfdbc69274707a8ab2857e62f7cc3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:29.653980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=473bfdbc69274707a8ab2857e62f7cc3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:29.655287 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:29.798643 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473bfdbc69274707a8ab2857e62f7cc3', 'request_id': 'req-a5270409-a371-43df-aa33-4e34bad9e7e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:29.804904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473bfdbc69274707a8ab2857e62f7cc3', 'request_id': 'req-a5270409-a371-43df-aa33-4e34bad9e7e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:29.811622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473bfdbc69274707a8ab2857e62f7cc3', 'request_id': 'req-a5270409-a371-43df-aa33-4e34bad9e7e0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:29.816145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:29.910813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] The token cache is being invalidate because project 473bfdbc69274707a8ab2857e62f7cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:29.911132 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:29.916742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a5270409-a371-43df-aa33-4e34bad9e7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:29.916742 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1312/2621] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:54:29 2022] DELETE /identity/v3/projects/473bfdbc69274707a8ab2857e62f7cc3 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:29.919618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5d7e-9335-4af8-9b5d-d759dbe17922 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:29.920082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5d7e-9335-4af8-9b5d-d759dbe17922 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:29.920286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee5d7e-9335-4af8-9b5d-d759dbe17922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:29.939808 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-9cee5d7e-9335-4af8-9b5d-d759dbe17922 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:29.941034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-9cee5d7e-9335-4af8-9b5d-d759dbe17922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:29.954659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:30.010306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1310/2622] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:30.018450 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5c49-2b7d-4bf7-bf5e-096757b21660 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:30.018774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5c49-2b7d-4bf7-bf5e-096757b21660 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:30.019029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158c5c49-2b7d-4bf7-bf5e-096757b21660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:30.039167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-158c5c49-2b7d-4bf7-bf5e-096757b21660 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:30.041012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-158c5c49-2b7d-4bf7-bf5e-096757b21660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:30.049699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1313/2623] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:30.055622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee5d7e-9335-4af8-9b5d-d759dbe17922 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:30.064826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee5d7e-9335-4af8-9b5d-d759dbe17922 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:30.070327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58963fce-5ea2-4934-8c73-7e422afbb5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:30.070998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963fce-5ea2-4934-8c73-7e422afbb5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:30.071283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963fce-5ea2-4934-8c73-7e422afbb5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:30.071562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963fce-5ea2-4934-8c73-7e422afbb5c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:30.072952 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58963fce-5ea2-4934-8c73-7e422afbb5c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:30.073546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58963fce-5ea2-4934-8c73-7e422afbb5c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:30.076136 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58963fce-5ea2-4934-8c73-7e422afbb5c7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:30.089845 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1311/2624] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:54:30.094732 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c5c49-2b7d-4bf7-bf5e-096757b21660 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:30.106179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158c5c49-2b7d-4bf7-bf5e-096757b21660 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:30.111897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff64f-41b0-4279-b1ab-e07716aa0703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:30.112838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff64f-41b0-4279-b1ab-e07716aa0703 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:30.113318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff64f-41b0-4279-b1ab-e07716aa0703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:30.113599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ff64f-41b0-4279-b1ab-e07716aa0703 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:30.114493 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ff64f-41b0-4279-b1ab-e07716aa0703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:30.116417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ff64f-41b0-4279-b1ab-e07716aa0703 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:30.282446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1314/2625] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:54:30 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:30.283931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58963fce-5ea2-4934-8c73-7e422afbb5c7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:30.294619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58963fce-5ea2-4934-8c73-7e422afbb5c7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:30.358321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862eae3-bc8e-4f85-893f-16423f89f489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:30.360153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862eae3-bc8e-4f85-893f-16423f89f489 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:30.360447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862eae3-bc8e-4f85-893f-16423f89f489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:30.360726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862eae3-bc8e-4f85-893f-16423f89f489 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:30.361429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862eae3-bc8e-4f85-893f-16423f89f489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:30.363422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e862eae3-bc8e-4f85-893f-16423f89f489 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:30.447626 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1312/2626] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:54:30 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:30.451722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff64f-41b0-4279-b1ab-e07716aa0703 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:30.462904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ff64f-41b0-4279-b1ab-e07716aa0703 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:30.467637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1634-c9f8-4f14-ac98-9ea52241a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:30.468859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1634-c9f8-4f14-ac98-9ea52241a89b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:30.470773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1634-c9f8-4f14-ac98-9ea52241a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:30.470773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b1634-c9f8-4f14-ac98-9ea52241a89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:30.470773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b1634-c9f8-4f14-ac98-9ea52241a89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:30.472082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b1634-c9f8-4f14-ac98-9ea52241a89b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:30.482915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1315/2627] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:30.487931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862eae3-bc8e-4f85-893f-16423f89f489 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:30.498179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e862eae3-bc8e-4f85-893f-16423f89f489 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:30.503118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf50cae-7c21-4b8f-8ec5-a5041c5d2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:30.503794 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf50cae-7c21-4b8f-8ec5-a5041c5d2a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:30.504077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf50cae-7c21-4b8f-8ec5-a5041c5d2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:30.504350 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf50cae-7c21-4b8f-8ec5-a5041c5d2a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:30.505073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf50cae-7c21-4b8f-8ec5-a5041c5d2a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:30.506756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf50cae-7c21-4b8f-8ec5-a5041c5d2a4d admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:30.522148 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1313/2628] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:30.526498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1634-c9f8-4f14-ac98-9ea52241a89b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:30.537920 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b1634-c9f8-4f14-ac98-9ea52241a89b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:30.542827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504f8ce-aa5b-417a-b50a-060cf65e0af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:30.543739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504f8ce-aa5b-417a-b50a-060cf65e0af3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:30.544051 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504f8ce-aa5b-417a-b50a-060cf65e0af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:30.544340 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504f8ce-aa5b-417a-b50a-060cf65e0af3 admin admin] PATH_INFO: `/v3/projects/148655f692d445798815e39b9af5b690/users/c4647badcc3f491d9ebf42e5a142e311/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:30.564121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504f8ce-aa5b-417a-b50a-060cf65e0af3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=148655f692d445798815e39b9af5b690, user_id=c4647badcc3f491d9ebf42e5a142e311, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:30.566867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504f8ce-aa5b-417a-b50a-060cf65e0af3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:30.688386 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1316/2629] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:54:30 2022] PUT /identity/v3/projects/148655f692d445798815e39b9af5b690/users/c4647badcc3f491d9ebf42e5a142e311/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:30.699711 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d85c-5b4a-4b15-b3e2-3df6c77ec319 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:30.699933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d85c-5b4a-4b15-b3e2-3df6c77ec319 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:30.700219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11d85c-5b4a-4b15-b3e2-3df6c77ec319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:30.730816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7c11d85c-5b4a-4b15-b3e2-3df6c77ec319 None None] MFA Rules not processed for user `c4647badcc3f491d9ebf42e5a142e311`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:30.732060 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7c11d85c-5b4a-4b15-b3e2-3df6c77ec319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:30.804169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1314/2630] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:30.808827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504f8ce-aa5b-417a-b50a-060cf65e0af3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:30.873495 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504f8ce-aa5b-417a-b50a-060cf65e0af3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:30.878778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3d028-84fa-4c80-b564-6db4757c22dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:30.879468 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3d028-84fa-4c80-b564-6db4757c22dd admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:30.879751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3d028-84fa-4c80-b564-6db4757c22dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:30.880173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3d028-84fa-4c80-b564-6db4757c22dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:30.880911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3d028-84fa-4c80-b564-6db4757c22dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:30.882843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc3d028-84fa-4c80-b564-6db4757c22dd admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:30.973553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1317/2631] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:54:30 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:30.977508 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d85c-5b4a-4b15-b3e2-3df6c77ec319 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:30.989106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11d85c-5b4a-4b15-b3e2-3df6c77ec319 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:30.998585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:31.046802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7ae1c-ffb3-42cf-b61a-998c17bba60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.047521 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7ae1c-ffb3-42cf-b61a-998c17bba60f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.047799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7ae1c-ffb3-42cf-b61a-998c17bba60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.048072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7ae1c-ffb3-42cf-b61a-998c17bba60f admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.048793 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7ae1c-ffb3-42cf-b61a-998c17bba60f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.050776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7ae1c-ffb3-42cf-b61a-998c17bba60f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.162038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1315/2632] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:54:30 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:31.166479 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3d028-84fa-4c80-b564-6db4757c22dd admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.178082 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3d028-84fa-4c80-b564-6db4757c22dd admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:31.182709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c5cc9-6547-4062-9d5f-6513132d48ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.183475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5cc9-6547-4062-9d5f-6513132d48ca admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.183794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5cc9-6547-4062-9d5f-6513132d48ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.184041 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c5cc9-6547-4062-9d5f-6513132d48ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.184769 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c5cc9-6547-4062-9d5f-6513132d48ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.186529 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c5cc9-6547-4062-9d5f-6513132d48ca admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.199579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1318/2633] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:31.203805 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7ae1c-ffb3-42cf-b61a-998c17bba60f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.213936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7ae1c-ffb3-42cf-b61a-998c17bba60f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:31.218518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773002a3-f67b-4455-890b-7706c5126aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.219177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773002a3-f67b-4455-890b-7706c5126aab admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.219458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773002a3-f67b-4455-890b-7706c5126aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.219731 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773002a3-f67b-4455-890b-7706c5126aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.220713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773002a3-f67b-4455-890b-7706c5126aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.222327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773002a3-f67b-4455-890b-7706c5126aab admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.232766 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1316/2634] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:54:31.237471 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c5cc9-6547-4062-9d5f-6513132d48ca admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.247505 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c5cc9-6547-4062-9d5f-6513132d48ca admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:31.253122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513490d2-adc9-49c0-ac4d-95f6f542b5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.254054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513490d2-adc9-49c0-ac4d-95f6f542b5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.254339 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513490d2-adc9-49c0-ac4d-95f6f542b5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.254612 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513490d2-adc9-49c0-ac4d-95f6f542b5f9 admin admin] PATH_INFO: `/v3/projects/b6b9589b0e1942e8abc3c51bef752e55/users/9c56d21959f84a6cabe336232a8cef52/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.270009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513490d2-adc9-49c0-ac4d-95f6f542b5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b9589b0e1942e8abc3c51bef752e55, user_id=9c56d21959f84a6cabe336232a8cef52, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.272675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513490d2-adc9-49c0-ac4d-95f6f542b5f9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.351658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1319/2635] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:54:31 2022] PUT /identity/v3/projects/b6b9589b0e1942e8abc3c51bef752e55/users/9c56d21959f84a6cabe336232a8cef52/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:31.362747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ab38b-16f5-4db7-9181-e934b6dc0e14 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.363047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ab38b-16f5-4db7-9181-e934b6dc0e14 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.363332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ab38b-16f5-4db7-9181-e934b6dc0e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.391915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-908ab38b-16f5-4db7-9181-e934b6dc0e14 None None] MFA Rules not processed for user `9c56d21959f84a6cabe336232a8cef52`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:31.393141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-908ab38b-16f5-4db7-9181-e934b6dc0e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:31.459058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1317/2636] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:31.463603 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513490d2-adc9-49c0-ac4d-95f6f542b5f9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.518705 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:31.535872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513490d2-adc9-49c0-ac4d-95f6f542b5f9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:31.540838 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0081fa5-c980-4a70-b07c-decd4c80a4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.541518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0081fa5-c980-4a70-b07c-decd4c80a4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.541832 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0081fa5-c980-4a70-b07c-decd4c80a4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.542117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0081fa5-c980-4a70-b07c-decd4c80a4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.542818 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0081fa5-c980-4a70-b07c-decd4c80a4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.544735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0081fa5-c980-4a70-b07c-decd4c80a4a7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.620647 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1320/2637] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:54:31 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:31.625281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ab38b-16f5-4db7-9181-e934b6dc0e14 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.636036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ab38b-16f5-4db7-9181-e934b6dc0e14 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:31.698287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b0d8c-b180-48bc-95a5-f6e3154c0abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.699047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0d8c-b180-48bc-95a5-f6e3154c0abd admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.699333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0d8c-b180-48bc-95a5-f6e3154c0abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.699620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0d8c-b180-48bc-95a5-f6e3154c0abd admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.700377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b0d8c-b180-48bc-95a5-f6e3154c0abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.702849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b0d8c-b180-48bc-95a5-f6e3154c0abd admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.814287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1318/2638] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:54:31 2022] POST /identity/v3/users => generated 295 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:31.819476 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0081fa5-c980-4a70-b07c-decd4c80a4a7 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.830797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0081fa5-c980-4a70-b07c-decd4c80a4a7 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:31.836204 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bebc76-5f07-4d2f-b607-cbab57005ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.836892 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bebc76-5f07-4d2f-b607-cbab57005ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.837186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bebc76-5f07-4d2f-b607-cbab57005ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.837486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bebc76-5f07-4d2f-b607-cbab57005ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.838238 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bebc76-5f07-4d2f-b607-cbab57005ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.839868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bebc76-5f07-4d2f-b607-cbab57005ffe admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.853519 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1321/2639] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:31.857917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b0d8c-b180-48bc-95a5-f6e3154c0abd admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.868010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b0d8c-b180-48bc-95a5-f6e3154c0abd admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:31.872815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ca4e0-efd4-412f-9b75-37c7fa557d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:31.873711 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca4e0-efd4-412f-9b75-37c7fa557d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:31.873998 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca4e0-efd4-412f-9b75-37c7fa557d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:31.874358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ca4e0-efd4-412f-9b75-37c7fa557d95 admin admin] PATH_INFO: `/v3/projects/4409ab92fabc48b889ab230a7c22403a/users/3602df8536d644b896d17837fe3f398c/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:31.882893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:31.889194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ca4e0-efd4-412f-9b75-37c7fa557d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4409ab92fabc48b889ab230a7c22403a, user_id=3602df8536d644b896d17837fe3f398c, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:31.892428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ca4e0-efd4-412f-9b75-37c7fa557d95 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:31.956777 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1319/2640] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:54:31 2022] PUT /identity/v3/projects/4409ab92fabc48b889ab230a7c22403a/users/3602df8536d644b896d17837fe3f398c/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:31.960979 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bebc76-5f07-4d2f-b607-cbab57005ffe admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:31.972237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bebc76-5f07-4d2f-b607-cbab57005ffe admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:32.028976 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e713a-d385-4a32-930b-1037e6d61d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:32.029640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e713a-d385-4a32-930b-1037e6d61d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:32.029961 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e713a-d385-4a32-930b-1037e6d61d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:32.030246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e713a-d385-4a32-930b-1037e6d61d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:32.031795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e713a-d385-4a32-930b-1037e6d61d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:32.033405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e713a-d385-4a32-930b-1037e6d61d95 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:32.043402 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1322/2641] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:32.047585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ca4e0-efd4-412f-9b75-37c7fa557d95 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:32.058486 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ca4e0-efd4-412f-9b75-37c7fa557d95 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:32.064732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30925948-90a8-4d2e-a486-31d6d5ae2f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:32.065532 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925948-90a8-4d2e-a486-31d6d5ae2f55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:32.065925 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925948-90a8-4d2e-a486-31d6d5ae2f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:32.066187 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30925948-90a8-4d2e-a486-31d6d5ae2f55 admin admin] PATH_INFO: `/v3/projects/4409ab92fabc48b889ab230a7c22403a/users/3602df8536d644b896d17837fe3f398c/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:32.068119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30925948-90a8-4d2e-a486-31d6d5ae2f55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4409ab92fabc48b889ab230a7c22403a, user_id=3602df8536d644b896d17837fe3f398c, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:32.070780 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30925948-90a8-4d2e-a486-31d6d5ae2f55 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:32.081931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1320/2642] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:54:32 2022] PUT /identity/v3/projects/4409ab92fabc48b889ab230a7c22403a/users/3602df8536d644b896d17837fe3f398c/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:32.093039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc374a-c4e6-4c68-89d1-16d17b6a7576 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:32.093952 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc374a-c4e6-4c68-89d1-16d17b6a7576 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:32.094256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc374a-c4e6-4c68-89d1-16d17b6a7576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:32.123322 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-dafc374a-c4e6-4c68-89d1-16d17b6a7576 None None] MFA Rules not processed for user `3602df8536d644b896d17837fe3f398c`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:32.125050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dafc374a-c4e6-4c68-89d1-16d17b6a7576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:32.208527 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1323/2643] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:32.221773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30925948-90a8-4d2e-a486-31d6d5ae2f55 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:32.223476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-30925948-90a8-4d2e-a486-31d6d5ae2f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:32.283324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30925948-90a8-4d2e-a486-31d6d5ae2f55 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:32.286997 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188dbbf-f474-48ef-9cf5-e7aefcca2a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:32.287645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188dbbf-f474-48ef-9cf5-e7aefcca2a9a service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:32.287962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188dbbf-f474-48ef-9cf5-e7aefcca2a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:32.288237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9188dbbf-f474-48ef-9cf5-e7aefcca2a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:32.297886 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188dbbf-f474-48ef-9cf5-e7aefcca2a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:32.299322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9188dbbf-f474-48ef-9cf5-e7aefcca2a9a service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:32.309114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1321/2644] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:54:32.441175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc374a-c4e6-4c68-89d1-16d17b6a7576 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:32.442584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-dafc374a-c4e6-4c68-89d1-16d17b6a7576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:32.455080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc374a-c4e6-4c68-89d1-16d17b6a7576 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:32.458701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edeb4eb-d561-4936-a6bd-c3ca39f73f71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:32.459344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeb4eb-d561-4936-a6bd-c3ca39f73f71 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:32.459633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeb4eb-d561-4936-a6bd-c3ca39f73f71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:32.459916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edeb4eb-d561-4936-a6bd-c3ca39f73f71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:32.493710 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:32.516860 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edeb4eb-d561-4936-a6bd-c3ca39f73f71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:32.518451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edeb4eb-d561-4936-a6bd-c3ca39f73f71 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:32.527384 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1324/2645] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:36.706594 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188dbbf-f474-48ef-9cf5-e7aefcca2a9a service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:36.768940 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9188dbbf-f474-48ef-9cf5-e7aefcca2a9a service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:36.773428 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:36.777705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:36.777705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:36.777705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] PATH_INFO: `/v3/users/c4647badcc3f491d9ebf42e5a142e311` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:36.777705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4647badcc3f491d9ebf42e5a142e311)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:36.779024 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:36.957785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4647badcc3f491d9ebf42e5a142e311'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:37.012546 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4647badcc3f491d9ebf42e5a142e311'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:37.013166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4647badcc3f491d9ebf42e5a142e311'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:37.013816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4647badcc3f491d9ebf42e5a142e311'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:37.026801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4647badcc3f491d9ebf42e5a142e311'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:37.032131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:37.040789 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1322/2646] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:54:36 2022] DELETE /identity/v3/users/c4647badcc3f491d9ebf42e5a142e311 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:37.045375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86766d05-7229-471d-bb19-57ee19e502d1 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:37.045879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86766d05-7229-471d-bb19-57ee19e502d1 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:37.046045 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86766d05-7229-471d-bb19-57ee19e502d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:37.063715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-86766d05-7229-471d-bb19-57ee19e502d1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:37.067506 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-86766d05-7229-471d-bb19-57ee19e502d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:37.127161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1325/2647] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:37.137110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:37.139774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:37.202124 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e351e-225c-4416-9c13-ebe41a429837 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:37.206740 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6724589-2b1e-45d7-b731-f3de481910fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:37.207397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6724589-2b1e-45d7-b731-f3de481910fb service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:37.207683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6724589-2b1e-45d7-b731-f3de481910fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:37.208038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6724589-2b1e-45d7-b731-f3de481910fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:37.217447 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6724589-2b1e-45d7-b731-f3de481910fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:37.218928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6724589-2b1e-45d7-b731-f3de481910fb service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:37.229907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1323/2648] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:37.681737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86766d05-7229-471d-bb19-57ee19e502d1 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:37.683171 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-86766d05-7229-471d-bb19-57ee19e502d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:37.697938 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86766d05-7229-471d-bb19-57ee19e502d1 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:37.703297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:37.704224 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:37.704508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:37.704783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] PATH_INFO: `/v3/projects/148655f692d445798815e39b9af5b690` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:37.706109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=148655f692d445798815e39b9af5b690)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:37.707973 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:37.807492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '148655f692d445798815e39b9af5b690', 'request_id': 'req-91c16347-7fab-4d7c-b262-7a7f2940fb78'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:37.813059 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '148655f692d445798815e39b9af5b690', 'request_id': 'req-91c16347-7fab-4d7c-b262-7a7f2940fb78'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:37.822223 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '148655f692d445798815e39b9af5b690', 'request_id': 'req-91c16347-7fab-4d7c-b262-7a7f2940fb78'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:37.904084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] The token cache is being invalidate because project 148655f692d445798815e39b9af5b690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:37.904377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:37.905005 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:37.906565 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1326/2649] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:54:37 2022] DELETE /identity/v3/projects/148655f692d445798815e39b9af5b690 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:37.910758 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6724589-2b1e-45d7-b731-f3de481910fb service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:37.921053 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6724589-2b1e-45d7-b731-f3de481910fb service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:37.980897 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:37.981686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:37.981983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:37.982254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] PATH_INFO: `/v3/users/9c56d21959f84a6cabe336232a8cef52` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:37.983435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c56d21959f84a6cabe336232a8cef52)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:37.985964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:38.181233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c56d21959f84a6cabe336232a8cef52'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:38.291466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c56d21959f84a6cabe336232a8cef52'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:38.292034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c56d21959f84a6cabe336232a8cef52'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:38.292679 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c56d21959f84a6cabe336232a8cef52'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:38.308602 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c56d21959f84a6cabe336232a8cef52'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:38.321342 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1324/2650] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:54:37 2022] DELETE /identity/v3/users/9c56d21959f84a6cabe336232a8cef52 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:39.054668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:39.057826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:39.069879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c16347-7fab-4d7c-b262-7a7f2940fb78 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:39.135674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:39.136220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:39.136507 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:39.136787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] PATH_INFO: `/v3/projects/b6b9589b0e1942e8abc3c51bef752e55` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:39.138035 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b9589b0e1942e8abc3c51bef752e55)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:39.139970 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:39.141606 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:39.262786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b9589b0e1942e8abc3c51bef752e55', 'request_id': 'req-bb24e45f-6e2c-471b-8b5e-3032b059766d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:39.269217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b9589b0e1942e8abc3c51bef752e55', 'request_id': 'req-bb24e45f-6e2c-471b-8b5e-3032b059766d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:39.275930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b9589b0e1942e8abc3c51bef752e55', 'request_id': 'req-bb24e45f-6e2c-471b-8b5e-3032b059766d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:39.390456 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] The token cache is being invalidate because project b6b9589b0e1942e8abc3c51bef752e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:39.390682 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:39.391291 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:39.392833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1327/2651] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:54:39 2022] DELETE /identity/v3/projects/b6b9589b0e1942e8abc3c51bef752e55 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:54:39.396842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:39.398294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:39.426914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c1e59-6f6a-486a-91fa-f6dec243e0d9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:39.441287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:39.507849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:39.508733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:39.509048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:39.509326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] PATH_INFO: `/v3/users/3602df8536d644b896d17837fe3f398c` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:39.510582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3602df8536d644b896d17837fe3f398c)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:39.512571 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:39.723996 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3602df8536d644b896d17837fe3f398c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:39.789820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3602df8536d644b896d17837fe3f398c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:39.790590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3602df8536d644b896d17837fe3f398c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:39.791129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3602df8536d644b896d17837fe3f398c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:39.804074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7f3684e0-64a1-4b4e-b1e4-37b195937bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3602df8536d644b896d17837fe3f398c'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:39.816061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1325/2652] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:54:39 2022] DELETE /identity/v3/users/3602df8536d644b896d17837fe3f398c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:40.463546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:40.465049 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:40.478063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24e45f-6e2c-471b-8b5e-3032b059766d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:40.540267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:40.541055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:40.541342 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:40.541626 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] PATH_INFO: `/v3/projects/4409ab92fabc48b889ab230a7c22403a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:40.543231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4409ab92fabc48b889ab230a7c22403a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:40.545189 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:40.662449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4409ab92fabc48b889ab230a7c22403a', 'request_id': 'req-8109239a-7a92-4446-9cbe-809ec1d166d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:40.668060 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4409ab92fabc48b889ab230a7c22403a', 'request_id': 'req-8109239a-7a92-4446-9cbe-809ec1d166d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:40.674904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4409ab92fabc48b889ab230a7c22403a', 'request_id': 'req-8109239a-7a92-4446-9cbe-809ec1d166d9'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:40.747247 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] The token cache is being invalidate because project 4409ab92fabc48b889ab230a7c22403a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:40.747542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:40.748167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8109239a-7a92-4446-9cbe-809ec1d166d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:40.749740 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1328/2653] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:54:40 2022] DELETE /identity/v3/projects/4409ab92fabc48b889ab230a7c22403a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:40.757262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702765-da30-47ea-8daf-40f9ab379f9f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:40.757818 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702765-da30-47ea-8daf-40f9ab379f9f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:40.757930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4702765-da30-47ea-8daf-40f9ab379f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:40.775800 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f4702765-da30-47ea-8daf-40f9ab379f9f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:40.777054 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f4702765-da30-47ea-8daf-40f9ab379f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:40.836593 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1326/2654] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:54:40.845184 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de107f-b3ec-4aa8-a481-0f7bf16b2015 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:40.845474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de107f-b3ec-4aa8-a481-0f7bf16b2015 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:40.845794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de107f-b3ec-4aa8-a481-0f7bf16b2015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:40.864561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a8de107f-b3ec-4aa8-a481-0f7bf16b2015 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:40.865786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a8de107f-b3ec-4aa8-a481-0f7bf16b2015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:40.873582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1329/2655] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:40.878192 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4702765-da30-47ea-8daf-40f9ab379f9f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:40.887635 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4702765-da30-47ea-8daf-40f9ab379f9f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:40.892114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959b04-6ac0-4764-ba64-eca0df830af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:40.892912 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959b04-6ac0-4764-ba64-eca0df830af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:40.893063 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959b04-6ac0-4764-ba64-eca0df830af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:40.893300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c959b04-6ac0-4764-ba64-eca0df830af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:40.894050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959b04-6ac0-4764-ba64-eca0df830af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:40.894358 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959b04-6ac0-4764-ba64-eca0df830af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:40.895929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c959b04-6ac0-4764-ba64-eca0df830af5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:40.907478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1327/2656] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:54:40.911627 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de107f-b3ec-4aa8-a481-0f7bf16b2015 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:40.920693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de107f-b3ec-4aa8-a481-0f7bf16b2015 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:40.925870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36061f-c73c-4919-9cce-7894b45e08ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:40.926512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36061f-c73c-4919-9cce-7894b45e08ab admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:40.926808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36061f-c73c-4919-9cce-7894b45e08ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:40.927077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36061f-c73c-4919-9cce-7894b45e08ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:40.927757 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36061f-c73c-4919-9cce-7894b45e08ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:40.929635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36061f-c73c-4919-9cce-7894b45e08ab admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:40.940016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:41.048123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1330/2657] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:54:40 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:41.052920 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959b04-6ac0-4764-ba64-eca0df830af5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:41.063207 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c959b04-6ac0-4764-ba64-eca0df830af5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:41.087743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:41.123818 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1379fff-5d7f-44ae-b9c4-62ea073d5ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:41.128485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1379fff-5d7f-44ae-b9c4-62ea073d5ace admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:41.128485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1379fff-5d7f-44ae-b9c4-62ea073d5ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:41.128485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1379fff-5d7f-44ae-b9c4-62ea073d5ace admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:41.128485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1379fff-5d7f-44ae-b9c4-62ea073d5ace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:41.128485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1379fff-5d7f-44ae-b9c4-62ea073d5ace admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:41.264354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1328/2658] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:54:41 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:41.268570 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36061f-c73c-4919-9cce-7894b45e08ab admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:41.279012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36061f-c73c-4919-9cce-7894b45e08ab admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:41.284608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a651cc-6302-4c25-8ef1-fcb3ce8bc2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:41.285294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a651cc-6302-4c25-8ef1-fcb3ce8bc2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:41.285642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a651cc-6302-4c25-8ef1-fcb3ce8bc2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:41.285913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a651cc-6302-4c25-8ef1-fcb3ce8bc2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:41.286876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a651cc-6302-4c25-8ef1-fcb3ce8bc2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:41.288333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a651cc-6302-4c25-8ef1-fcb3ce8bc2ba admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:41.299716 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1331/2659] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:41.304157 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1379fff-5d7f-44ae-b9c4-62ea073d5ace admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:41.315012 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1379fff-5d7f-44ae-b9c4-62ea073d5ace admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:41.325719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2631-260d-420a-92f1-82ba06addbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:41.328511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2631-260d-420a-92f1-82ba06addbca admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:41.328511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2631-260d-420a-92f1-82ba06addbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:41.328511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2631-260d-420a-92f1-82ba06addbca admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:41.328511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f2631-260d-420a-92f1-82ba06addbca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:41.329406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f2631-260d-420a-92f1-82ba06addbca admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:41.344085 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1329/2660] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:41.346202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a651cc-6302-4c25-8ef1-fcb3ce8bc2ba admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:41.357274 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a651cc-6302-4c25-8ef1-fcb3ce8bc2ba admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:41.363394 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa946b4-d1c3-418c-8054-fb8d55720906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:41.364300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa946b4-d1c3-418c-8054-fb8d55720906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:41.364611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa946b4-d1c3-418c-8054-fb8d55720906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:41.364895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa946b4-d1c3-418c-8054-fb8d55720906 admin admin] PATH_INFO: `/v3/projects/a0163bdd44534543a1f205dd51988102/users/65ce52a67e9c4ce9bd4a8a5bdb581300/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:41.381388 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa946b4-d1c3-418c-8054-fb8d55720906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0163bdd44534543a1f205dd51988102, user_id=65ce52a67e9c4ce9bd4a8a5bdb581300, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:41.385975 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa946b4-d1c3-418c-8054-fb8d55720906 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:41.485854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1332/2661] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:54:41 2022] PUT /identity/v3/projects/a0163bdd44534543a1f205dd51988102/users/65ce52a67e9c4ce9bd4a8a5bdb581300/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:41.497251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cffe8-b842-4ff3-8e43-6b105b3c8818 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:41.497545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cffe8-b842-4ff3-8e43-6b105b3c8818 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:41.497866 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864cffe8-b842-4ff3-8e43-6b105b3c8818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:41.525443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-864cffe8-b842-4ff3-8e43-6b105b3c8818 None None] MFA Rules not processed for user `65ce52a67e9c4ce9bd4a8a5bdb581300`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:41.526722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-864cffe8-b842-4ff3-8e43-6b105b3c8818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:41.594061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1330/2662] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:41.606976 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa946b4-d1c3-418c-8054-fb8d55720906 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:41.608715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3fa946b4-d1c3-418c-8054-fb8d55720906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:41.665646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa946b4-d1c3-418c-8054-fb8d55720906 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:41.669346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9fc10-7d2f-468b-a41d-a6f470521bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:41.670024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9fc10-7d2f-468b-a41d-a6f470521bcd service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:41.670314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9fc10-7d2f-468b-a41d-a6f470521bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:41.670595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9fc10-7d2f-468b-a41d-a6f470521bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:41.678976 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9fc10-7d2f-468b-a41d-a6f470521bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:41.680411 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee9fc10-7d2f-468b-a41d-a6f470521bcd service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:41.689239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1333/2663] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:41.708995 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cffe8-b842-4ff3-8e43-6b105b3c8818 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:41.770709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864cffe8-b842-4ff3-8e43-6b105b3c8818 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:41.775285 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:41.776143 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:41.776429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:41.776704 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] PATH_INFO: `/v3/users/65ce52a67e9c4ce9bd4a8a5bdb581300` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:41.777927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ce52a67e9c4ce9bd4a8a5bdb581300)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:41.779833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:41.943433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:41.952115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ce52a67e9c4ce9bd4a8a5bdb581300'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:42.023738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ce52a67e9c4ce9bd4a8a5bdb581300'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:42.024371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ce52a67e9c4ce9bd4a8a5bdb581300'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:42.025112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ce52a67e9c4ce9bd4a8a5bdb581300'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:42.038443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ce52a67e9c4ce9bd4a8a5bdb581300'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:42.050921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1331/2664] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:54:41 2022] DELETE /identity/v3/users/65ce52a67e9c4ce9bd4a8a5bdb581300 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:42.055628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e65cc-bea3-47fd-9886-81248771948f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:42.055980 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e65cc-bea3-47fd-9886-81248771948f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:42.056267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e65cc-bea3-47fd-9886-81248771948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:42.074178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-011e65cc-bea3-47fd-9886-81248771948f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:42.075420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-011e65cc-bea3-47fd-9886-81248771948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:42.134530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1334/2665] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:42.144889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:42.146442 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:42.205435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560dcb1-7ba5-492b-8b14-256971759e3a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:42.209135 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f872c5da-bd0c-4b54-baf5-6cbcb031a2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:42.209881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872c5da-bd0c-4b54-baf5-6cbcb031a2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:42.210187 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872c5da-bd0c-4b54-baf5-6cbcb031a2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:42.210465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f872c5da-bd0c-4b54-baf5-6cbcb031a2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:42.219458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872c5da-bd0c-4b54-baf5-6cbcb031a2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:42.221228 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f872c5da-bd0c-4b54-baf5-6cbcb031a2b9 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:42.230700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1332/2666] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:42.660408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e65cc-bea3-47fd-9886-81248771948f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:42.662112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-011e65cc-bea3-47fd-9886-81248771948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:42.676737 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e65cc-bea3-47fd-9886-81248771948f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:42.682046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:42.683006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:42.683378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:42.683715 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] PATH_INFO: `/v3/projects/a0163bdd44534543a1f205dd51988102` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:42.684995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0163bdd44534543a1f205dd51988102)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:42.687025 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:42.800016 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0163bdd44534543a1f205dd51988102', 'request_id': 'req-5cbf29f4-8054-44da-af46-7a13d620c810'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:42.803816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:42.805937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0163bdd44534543a1f205dd51988102', 'request_id': 'req-5cbf29f4-8054-44da-af46-7a13d620c810'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:42.812076 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0163bdd44534543a1f205dd51988102', 'request_id': 'req-5cbf29f4-8054-44da-af46-7a13d620c810'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:42.889560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] The token cache is being invalidate because project a0163bdd44534543a1f205dd51988102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:54:42.889879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:42.890499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-5cbf29f4-8054-44da-af46-7a13d620c810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:54:42.892576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1335/2667] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:54:42 2022] DELETE /identity/v3/projects/a0163bdd44534543a1f205dd51988102 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:42.897376 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6ccda-0888-4765-b404-f5f4d6114b82 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:42.897862 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6ccda-0888-4765-b404-f5f4d6114b82 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:42.898001 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6ccda-0888-4765-b404-f5f4d6114b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:42.915675 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-59e6ccda-0888-4765-b404-f5f4d6114b82 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:42.916875 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-59e6ccda-0888-4765-b404-f5f4d6114b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:42.975033 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1333/2668] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:43.035993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c622622-5785-4af5-beac-622bafff9b86 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:43.036284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c622622-5785-4af5-beac-622bafff9b86 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:43.036569 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c622622-5785-4af5-beac-622bafff9b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:43.055221 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-4c622622-5785-4af5-beac-622bafff9b86 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:43.056360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-4c622622-5785-4af5-beac-622bafff9b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:43.064324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1336/2669] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:54:43.068539 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6ccda-0888-4765-b404-f5f4d6114b82 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:43.078271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6ccda-0888-4765-b404-f5f4d6114b82 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:43.083517 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66434ca2-1570-4f58-b178-d80c874fd830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:43.084175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66434ca2-1570-4f58-b178-d80c874fd830 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:43.084463 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66434ca2-1570-4f58-b178-d80c874fd830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:43.084744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66434ca2-1570-4f58-b178-d80c874fd830 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:43.085467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66434ca2-1570-4f58-b178-d80c874fd830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:54:43.085814 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66434ca2-1570-4f58-b178-d80c874fd830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:43.087423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66434ca2-1570-4f58-b178-d80c874fd830 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:43.099909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1334/2670] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:54:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:54:43.104179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c622622-5785-4af5-beac-622bafff9b86 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:43.113280 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c622622-5785-4af5-beac-622bafff9b86 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:43.117904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0eef7-51a2-48d9-8d80-ba49a4bc9b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:43.118557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0eef7-51a2-48d9-8d80-ba49a4bc9b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:43.118840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0eef7-51a2-48d9-8d80-ba49a4bc9b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:43.119120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0eef7-51a2-48d9-8d80-ba49a4bc9b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:43.119817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0eef7-51a2-48d9-8d80-ba49a4bc9b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:43.121740 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0eef7-51a2-48d9-8d80-ba49a4bc9b5e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:43.231273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1337/2671] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:54:43 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:43.235291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66434ca2-1570-4f58-b178-d80c874fd830 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:43.245332 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66434ca2-1570-4f58-b178-d80c874fd830 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:43.286098 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:43.303308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce5f3f-c966-4874-8321-6da48edd0da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:43.303970 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce5f3f-c966-4874-8321-6da48edd0da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:43.304277 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce5f3f-c966-4874-8321-6da48edd0da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:43.304559 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce5f3f-c966-4874-8321-6da48edd0da0 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:43.305298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce5f3f-c966-4874-8321-6da48edd0da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:43.307180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce5f3f-c966-4874-8321-6da48edd0da0 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:43.526020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1335/2672] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:54:43 2022] POST /identity/v3/users => generated 286 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:54:43.529827 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0eef7-51a2-48d9-8d80-ba49a4bc9b5e admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:43.540100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0eef7-51a2-48d9-8d80-ba49a4bc9b5e admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:43.544841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0389f-63e7-4e5a-9f67-9d2ff7a43f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:43.545492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0389f-63e7-4e5a-9f67-9d2ff7a43f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:43.545808 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0389f-63e7-4e5a-9f67-9d2ff7a43f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:43.546085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0389f-63e7-4e5a-9f67-9d2ff7a43f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:43.546799 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0389f-63e7-4e5a-9f67-9d2ff7a43f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:43.548593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0389f-63e7-4e5a-9f67-9d2ff7a43f4c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:43.558981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1338/2673] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:54:43.563017 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce5f3f-c966-4874-8321-6da48edd0da0 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:43.573409 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce5f3f-c966-4874-8321-6da48edd0da0 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:43.577913 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9fbbe-e340-4cad-87fd-f0f8165362f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:43.578558 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9fbbe-e340-4cad-87fd-f0f8165362f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:43.578840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9fbbe-e340-4cad-87fd-f0f8165362f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:43.579116 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9fbbe-e340-4cad-87fd-f0f8165362f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:43.579827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9fbbe-e340-4cad-87fd-f0f8165362f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:43.582126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9fbbe-e340-4cad-87fd-f0f8165362f4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:43.592027 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1336/2674] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:54:43.596398 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0389f-63e7-4e5a-9f67-9d2ff7a43f4c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:43.606694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0389f-63e7-4e5a-9f67-9d2ff7a43f4c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:43.611273 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d464e9d-706c-4b35-8352-5062623936aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:43.612802 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d464e9d-706c-4b35-8352-5062623936aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:43.613085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d464e9d-706c-4b35-8352-5062623936aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:43.613366 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d464e9d-706c-4b35-8352-5062623936aa admin admin] PATH_INFO: `/v3/projects/6a43dd5e9d7841419a87df430827af67/users/f1cdcc03aee2493eb40013a66243cf38/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:43.629156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d464e9d-706c-4b35-8352-5062623936aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a43dd5e9d7841419a87df430827af67, user_id=f1cdcc03aee2493eb40013a66243cf38, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:43.631857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d464e9d-706c-4b35-8352-5062623936aa admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:43.727655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1339/2675] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:54:43 2022] PUT /identity/v3/projects/6a43dd5e9d7841419a87df430827af67/users/f1cdcc03aee2493eb40013a66243cf38/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:54:43.732776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98110e1b-dbae-41c8-96c6-9296613c5ea1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:43.733069 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98110e1b-dbae-41c8-96c6-9296613c5ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:43.733345 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98110e1b-dbae-41c8-96c6-9296613c5ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:43.751821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-98110e1b-dbae-41c8-96c6-9296613c5ea1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:43.753651 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-98110e1b-dbae-41c8-96c6-9296613c5ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:43.818466 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1337/2676] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:43.827895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d464e9d-706c-4b35-8352-5062623936aa admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:43.829675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6d464e9d-706c-4b35-8352-5062623936aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:43.888701 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d464e9d-706c-4b35-8352-5062623936aa admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:43.892246 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199d29f-b1a2-47b6-965c-c055501b63d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:43.892885 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199d29f-b1a2-47b6-965c-c055501b63d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:43.893169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199d29f-b1a2-47b6-965c-c055501b63d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:43.893442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199d29f-b1a2-47b6-965c-c055501b63d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:43.902903 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199d29f-b1a2-47b6-965c-c055501b63d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:43.904327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199d29f-b1a2-47b6-965c-c055501b63d3 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:43.913765 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1340/2677] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:45.205079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95df628-5540-4e05-976a-eb24f99842ac None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:45.205621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95df628-5540-4e05-976a-eb24f99842ac None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:45.205621 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95df628-5540-4e05-976a-eb24f99842ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:45.234047 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b95df628-5540-4e05-976a-eb24f99842ac None None] MFA Rules not processed for user `f1cdcc03aee2493eb40013a66243cf38`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:45.235261 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b95df628-5540-4e05-976a-eb24f99842ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:45.303431 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1338/2678] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:45.314638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199d29f-b1a2-47b6-965c-c055501b63d3 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:45.318721 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7199d29f-b1a2-47b6-965c-c055501b63d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:45.376408 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199d29f-b1a2-47b6-965c-c055501b63d3 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:45.380573 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b8ced-0fb4-4966-bc20-2e7911c6674f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:45.381217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b8ced-0fb4-4966-bc20-2e7911c6674f service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:45.381504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b8ced-0fb4-4966-bc20-2e7911c6674f service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:45.381820 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b8ced-0fb4-4966-bc20-2e7911c6674f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:45.390045 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b8ced-0fb4-4966-bc20-2e7911c6674f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:45.391478 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b8ced-0fb4-4966-bc20-2e7911c6674f service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:45.400192 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1341/2679] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:54:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:47.162994 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d86a-4ba0-4e59-9960-3d7ddf3c65c9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:47.164253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d86a-4ba0-4e59-9960-3d7ddf3c65c9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:47.164253 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368d86a-4ba0-4e59-9960-3d7ddf3c65c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:47.181696 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5368d86a-4ba0-4e59-9960-3d7ddf3c65c9 None None] MFA Rules not processed for user `f1cdcc03aee2493eb40013a66243cf38`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:47.182909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5368d86a-4ba0-4e59-9960-3d7ddf3c65c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:47.189984 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1339/2680] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:55.396220 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=2,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:57.176032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=77,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:04.403042 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5369-79de-412f-a7b2-5504516329c5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:04.403552 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5369-79de-412f-a7b2-5504516329c5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:04.403646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff5369-79de-412f-a7b2-5504516329c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:04.420511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a3ff5369-79de-412f-a7b2-5504516329c5 None None] MFA Rules not processed for user `f1cdcc03aee2493eb40013a66243cf38`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:04.421751 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a3ff5369-79de-412f-a7b2-5504516329c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:04.428591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1342/2681] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:55:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:14.415557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:27.143319 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8cb3-4873-4ee1-aed7-0b4b88d1e7ad None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:27.151950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8cb3-4873-4ee1-aed7-0b4b88d1e7ad None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:27.151950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8cb3-4873-4ee1-aed7-0b4b88d1e7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:27.162457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-22ec8cb3-4873-4ee1-aed7-0b4b88d1e7ad None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:27.163650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-22ec8cb3-4873-4ee1-aed7-0b4b88d1e7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:27.220513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1340/2682] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 12:55:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:55:27.263297 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff5369-79de-412f-a7b2-5504516329c5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:27.264690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a3ff5369-79de-412f-a7b2-5504516329c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:27.336730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff5369-79de-412f-a7b2-5504516329c5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:27.341745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b0a26-a2b3-443c-916d-d88670a027de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:27.342417 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b0a26-a2b3-443c-916d-d88670a027de service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:27.342708 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b0a26-a2b3-443c-916d-d88670a027de service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:27.342992 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b0a26-a2b3-443c-916d-d88670a027de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:27.354785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b0a26-a2b3-443c-916d-d88670a027de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:27.356002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b0a26-a2b3-443c-916d-d88670a027de service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:27.364663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1343/2683] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:55:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:55:37.213688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=25 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:37.361157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=32 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:43.917944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75005b0-47fe-4c4d-9345-8df4ea96b274 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.918507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75005b0-47fe-4c4d-9345-8df4ea96b274 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.918507 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75005b0-47fe-4c4d-9345-8df4ea96b274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.938771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e75005b0-47fe-4c4d-9345-8df4ea96b274 None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:43.940009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e75005b0-47fe-4c4d-9345-8df4ea96b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:43.947349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1341/2684] 10.222.0.41 () {58 vars in 967 bytes} [Thu May 26 12:55:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:43.959988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b0a26-a2b3-443c-916d-d88670a027de service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:43.970833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b0a26-a2b3-443c-916d-d88670a027de service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:43.976720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc894f4f-af92-4a3f-b167-210096045ac1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:43.977357 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc894f4f-af92-4a3f-b167-210096045ac1 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.977644 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc894f4f-af92-4a3f-b167-210096045ac1 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.977957 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc894f4f-af92-4a3f-b167-210096045ac1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.986196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc894f4f-af92-4a3f-b167-210096045ac1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:43.987868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc894f4f-af92-4a3f-b167-210096045ac1 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:43.995947 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1344/2685] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:55:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:55:47.106189 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75005b0-47fe-4c4d-9345-8df4ea96b274 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:47.110470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e75005b0-47fe-4c4d-9345-8df4ea96b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:47.188361 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75005b0-47fe-4c4d-9345-8df4ea96b274 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:47.193363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48ed34-0fe8-4504-9f41-b782362553a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:47.194076 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48ed34-0fe8-4504-9f41-b782362553a3 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:47.194366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48ed34-0fe8-4504-9f41-b782362553a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:47.194678 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48ed34-0fe8-4504-9f41-b782362553a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:47.196450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1b48ed34-0fe8-4504-9f41-b782362553a3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:47.207817 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48ed34-0fe8-4504-9f41-b782362553a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:47.210077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48ed34-0fe8-4504-9f41-b782362553a3 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:47.222198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1342/2686] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:55:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:47.230667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc894f4f-af92-4a3f-b167-210096045ac1 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:47.243785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc894f4f-af92-4a3f-b167-210096045ac1 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:47.248518 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:47.249483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:47.250057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:47.250400 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] PATH_INFO: `/v3/users/f1cdcc03aee2493eb40013a66243cf38` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:47.251700 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1cdcc03aee2493eb40013a66243cf38)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:47.253885 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:47.443763 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1cdcc03aee2493eb40013a66243cf38'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:47.444662 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1cdcc03aee2493eb40013a66243cf38'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:47.554080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1cdcc03aee2493eb40013a66243cf38'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:47.554693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1cdcc03aee2493eb40013a66243cf38'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:47.567898 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1cdcc03aee2493eb40013a66243cf38'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:47.580667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1345/2687] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:55:47 2022] DELETE /identity/v3/users/f1cdcc03aee2493eb40013a66243cf38 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:47.849836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48ed34-0fe8-4504-9f41-b782362553a3 service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:47.861937 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48ed34-0fe8-4504-9f41-b782362553a3 service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:47.927915 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:47.929394 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:47.929820 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:47.930103 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] PATH_INFO: `/v3/projects/6a43dd5e9d7841419a87df430827af67` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:47.931271 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a43dd5e9d7841419a87df430827af67)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:47.933166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:48.040286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a43dd5e9d7841419a87df430827af67', 'request_id': 'req-88d7372b-1047-45a0-bb80-fb640e250f8e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:48.046497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a43dd5e9d7841419a87df430827af67', 'request_id': 'req-88d7372b-1047-45a0-bb80-fb640e250f8e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:48.057164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a43dd5e9d7841419a87df430827af67', 'request_id': 'req-88d7372b-1047-45a0-bb80-fb640e250f8e'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:48.136555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] The token cache is being invalidate because project 6a43dd5e9d7841419a87df430827af67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:48.137217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:48.137545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:48.139266 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1343/2688] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:55:47 2022] DELETE /identity/v3/projects/6a43dd5e9d7841419a87df430827af67 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:57.577030 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:58.133817 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:06.497438 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:06.501385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:06.557896 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b2f826-7239-4b19-951f-0da2b78948d5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:06.607141 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816483ea-c2f1-4aa9-b9c7-35eb91eef195 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:06.607792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816483ea-c2f1-4aa9-b9c7-35eb91eef195 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:06.608079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816483ea-c2f1-4aa9-b9c7-35eb91eef195 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:06.608380 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816483ea-c2f1-4aa9-b9c7-35eb91eef195 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:06.610186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-816483ea-c2f1-4aa9-b9c7-35eb91eef195 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:06.679171 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816483ea-c2f1-4aa9-b9c7-35eb91eef195 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:06.684512 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816483ea-c2f1-4aa9-b9c7-35eb91eef195 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:06.691796 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1346/2689] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:56:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:08.706596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:08.708044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:08.720477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7372b-1047-45a0-bb80-fb640e250f8e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:08.724032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c8967-6d5a-4870-a497-7dea6a6ad823 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:08.724670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c8967-6d5a-4870-a497-7dea6a6ad823 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:08.724956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c8967-6d5a-4870-a497-7dea6a6ad823 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:08.725237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639c8967-6d5a-4870-a497-7dea6a6ad823 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:08.727493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-639c8967-6d5a-4870-a497-7dea6a6ad823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:08.787075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c8967-6d5a-4870-a497-7dea6a6ad823 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:08.788512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639c8967-6d5a-4870-a497-7dea6a6ad823 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:08.798667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1344/2690] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:56:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:13.429282 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d0b3-3db3-47c2-8b22-23325e2afbb3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:13.429794 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d0b3-3db3-47c2-8b22-23325e2afbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:13.429924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8d0b3-3db3-47c2-8b22-23325e2afbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:13.447309 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2cd8d0b3-3db3-47c2-8b22-23325e2afbb3 None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:13.448488 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2cd8d0b3-3db3-47c2-8b22-23325e2afbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:13.503555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1347/2691] 10.222.0.41 () {58 vars in 967 bytes} [Thu May 26 12:56:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:13.516005 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c8967-6d5a-4870-a497-7dea6a6ad823 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:13.517425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-639c8967-6d5a-4870-a497-7dea6a6ad823 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:13.600812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639c8967-6d5a-4870-a497-7dea6a6ad823 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:13.606108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a7a40-6774-4589-9dad-af9c4804b618 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:13.606759 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a7a40-6774-4589-9dad-af9c4804b618 service swift] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:13.607042 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a7a40-6774-4589-9dad-af9c4804b618 service swift] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:13.607316 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a7a40-6774-4589-9dad-af9c4804b618 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:13.615769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a7a40-6774-4589-9dad-af9c4804b618 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:13.617929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a7a40-6774-4589-9dad-af9c4804b618 service swift] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:13.626484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1345/2692] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 12:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:56:17.516315 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1d1ab-f5da-4de9-83c5-75811ee1d31a None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:17.516760 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1d1ab-f5da-4de9-83c5-75811ee1d31a None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:17.516871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1d1ab-f5da-4de9-83c5-75811ee1d31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:17.523148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:17.539163 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d1d1d1ab-f5da-4de9-83c5-75811ee1d31a None None] MFA Rules not processed for user `b47d51863b0448b880dc03b01dec6dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:17.540531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d1d1d1ab-f5da-4de9-83c5-75811ee1d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:17.548172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1348/2693] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:56:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:23.159509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a7a40-6774-4589-9dad-af9c4804b618 service swift] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:23.162530 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ac6a7a40-6774-4589-9dad-af9c4804b618 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:23.258856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a7a40-6774-4589-9dad-af9c4804b618 service swift] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:23.264294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01eeb2-e23f-4f2d-a58c-7169f5fa3c5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:23.265038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01eeb2-e23f-4f2d-a58c-7169f5fa3c5f service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:23.265331 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01eeb2-e23f-4f2d-a58c-7169f5fa3c5f service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:23.265615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01eeb2-e23f-4f2d-a58c-7169f5fa3c5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:23.267770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-fc01eeb2-e23f-4f2d-a58c-7169f5fa3c5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:23.283705 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01eeb2-e23f-4f2d-a58c-7169f5fa3c5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:23.285322 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01eeb2-e23f-4f2d-a58c-7169f5fa3c5f service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:23.297259 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1346/2694] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:56:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:23.335180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1d1ab-f5da-4de9-83c5-75811ee1d31a None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:23.337096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d1d1d1ab-f5da-4de9-83c5-75811ee1d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:23.421336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1d1ab-f5da-4de9-83c5-75811ee1d31a None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:23.427728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:23.429829 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:23.430206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:23.430559 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] PATH_INFO: `/v3/users/7277aedb35df448e8b3056f8bc395e32` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:23.433810 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7277aedb35df448e8b3056f8bc395e32)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:23.435966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:23.639772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7277aedb35df448e8b3056f8bc395e32'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:23.640444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7277aedb35df448e8b3056f8bc395e32'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:23.725043 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7277aedb35df448e8b3056f8bc395e32'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:23.725894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7277aedb35df448e8b3056f8bc395e32'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:23.740551 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7277aedb35df448e8b3056f8bc395e32'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:23.753984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1349/2695] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:56:23 2022] DELETE /identity/v3/users/7277aedb35df448e8b3056f8bc395e32 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:24.138418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01eeb2-e23f-4f2d-a58c-7169f5fa3c5f service placement] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:24.151286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01eeb2-e23f-4f2d-a58c-7169f5fa3c5f service placement] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:24.175979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=100 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:24.223287 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:24.224151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:24.224435 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:24.224710 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] PATH_INFO: `/v3/projects/c876091609fe45ba80370a16748cbeb2` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:24.226155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c876091609fe45ba80370a16748cbeb2)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:24.228082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:24.360449 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:24.362055 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:24.372343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c876091609fe45ba80370a16748cbeb2', 'request_id': 'req-6b2af6bb-209e-44c2-bc77-9c646f3321bf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:24.378484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c876091609fe45ba80370a16748cbeb2', 'request_id': 'req-6b2af6bb-209e-44c2-bc77-9c646f3321bf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:24.387129 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c876091609fe45ba80370a16748cbeb2', 'request_id': 'req-6b2af6bb-209e-44c2-bc77-9c646f3321bf'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:24.423803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1a0b0-873d-4388-96ea-9e4bf9aceaed admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:24.453832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] The token cache is being invalidate because project c876091609fe45ba80370a16748cbeb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:56:24.454067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:24.454185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:24.454772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:24.456336 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1347/2696] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:56:24 2022] DELETE /identity/v3/projects/c876091609fe45ba80370a16748cbeb2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:24.460194 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:24.461574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:24.476745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9060569-d1b4-4287-84cf-dec01c381ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:24.477511 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9060569-d1b4-4287-84cf-dec01c381ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:24.477906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9060569-d1b4-4287-84cf-dec01c381ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:24.478256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9060569-d1b4-4287-84cf-dec01c381ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:24.480140 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e9060569-d1b4-4287-84cf-dec01c381ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:24.529645 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af6bb-209e-44c2-bc77-9c646f3321bf admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:24.534344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:24.535218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:24.535494 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:24.535771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] PATH_INFO: `/v3/users/6a431482ce4c4c11821e90203ddd35e7` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:24.536955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a431482ce4c4c11821e90203ddd35e7)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:24.538889 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:24.555212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9060569-d1b4-4287-84cf-dec01c381ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:24.556756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9060569-d1b4-4287-84cf-dec01c381ec2 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:24.569086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1350/2697] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:56:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:56:24.745781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a431482ce4c4c11821e90203ddd35e7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:24.748395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:24.848832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a431482ce4c4c11821e90203ddd35e7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:24.849574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a431482ce4c4c11821e90203ddd35e7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:24.850210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a431482ce4c4c11821e90203ddd35e7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:24.863595 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-971ba365-3b9e-4065-8e54-3b74c0982baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a431482ce4c4c11821e90203ddd35e7'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:24.879597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1348/2698] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:56:24 2022] DELETE /identity/v3/users/6a431482ce4c4c11821e90203ddd35e7 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:56:25.133775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9060569-d1b4-4287-84cf-dec01c381ec2 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:25.144906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9060569-d1b4-4287-84cf-dec01c381ec2 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:25.223282 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:25.224100 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:25.224391 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:25.224673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] PATH_INFO: `/v3/projects/9f0fde7fb08644efaba1845b2cbd7a54` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:25.225932 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0fde7fb08644efaba1845b2cbd7a54)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:25.229588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:25.349044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0fde7fb08644efaba1845b2cbd7a54', 'request_id': 'req-b7c38676-1d52-4b36-a4ad-497af9b414a7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:25.355175 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0fde7fb08644efaba1845b2cbd7a54', 'request_id': 'req-b7c38676-1d52-4b36-a4ad-497af9b414a7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:25.361298 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0fde7fb08644efaba1845b2cbd7a54', 'request_id': 'req-b7c38676-1d52-4b36-a4ad-497af9b414a7'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:25.448405 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] The token cache is being invalidate because project 9f0fde7fb08644efaba1845b2cbd7a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:56:25.448697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:25.449327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b7c38676-1d52-4b36-a4ad-497af9b414a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:25.450902 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1351/2699] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:56:25 2022] DELETE /identity/v3/projects/9f0fde7fb08644efaba1845b2cbd7a54 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:56:25.455833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30457a8-5124-4b8f-ab39-2a2ddb4e2dc7 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:25.456340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30457a8-5124-4b8f-ab39-2a2ddb4e2dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:25.456444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30457a8-5124-4b8f-ab39-2a2ddb4e2dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:25.474739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f30457a8-5124-4b8f-ab39-2a2ddb4e2dc7 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:25.475878 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f30457a8-5124-4b8f-ab39-2a2ddb4e2dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:25.535597 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1349/2700] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:25.597263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2a937-284d-4863-8d85-67a10fbf8a12 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:25.597553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2a937-284d-4863-8d85-67a10fbf8a12 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:25.597870 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee2a937-284d-4863-8d85-67a10fbf8a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:25.604243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:25.616390 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-0ee2a937-284d-4863-8d85-67a10fbf8a12 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:25.617725 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-0ee2a937-284d-4863-8d85-67a10fbf8a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:25.625642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1352/2701] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:56:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:25.629879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30457a8-5124-4b8f-ab39-2a2ddb4e2dc7 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:25.640425 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30457a8-5124-4b8f-ab39-2a2ddb4e2dc7 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:25.645082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777318e-5c45-449f-97f9-d55eec119dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:25.645767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777318e-5c45-449f-97f9-d55eec119dae admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:25.646050 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777318e-5c45-449f-97f9-d55eec119dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:25.646325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777318e-5c45-449f-97f9-d55eec119dae admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:25.647074 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777318e-5c45-449f-97f9-d55eec119dae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:56:25.647378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777318e-5c45-449f-97f9-d55eec119dae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:25.649029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777318e-5c45-449f-97f9-d55eec119dae admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:25.661296 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1350/2702] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:56:25.665813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2a937-284d-4863-8d85-67a10fbf8a12 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:25.676033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee2a937-284d-4863-8d85-67a10fbf8a12 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:25.680893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c12895-4af5-4be7-be35-6f87474e08d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:25.681890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c12895-4af5-4be7-be35-6f87474e08d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:25.682057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c12895-4af5-4be7-be35-6f87474e08d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:25.682325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c12895-4af5-4be7-be35-6f87474e08d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:25.683029 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c12895-4af5-4be7-be35-6f87474e08d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:25.684978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c12895-4af5-4be7-be35-6f87474e08d0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:25.856058 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1353/2703] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:56:25 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:56:25.857249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777318e-5c45-449f-97f9-d55eec119dae admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:25.867263 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777318e-5c45-449f-97f9-d55eec119dae admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:25.931873 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1829534-35c7-4f53-a08f-767c96d2c136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:25.932538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1829534-35c7-4f53-a08f-767c96d2c136 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:25.932822 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1829534-35c7-4f53-a08f-767c96d2c136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:25.933101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1829534-35c7-4f53-a08f-767c96d2c136 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:25.933815 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1829534-35c7-4f53-a08f-767c96d2c136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:25.935864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1829534-35c7-4f53-a08f-767c96d2c136 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:26.024381 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1351/2704] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:56:25 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:56:26.028185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c12895-4af5-4be7-be35-6f87474e08d0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:26.038772 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c12895-4af5-4be7-be35-6f87474e08d0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:26.043619 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb985629-5f61-4782-928b-839bc4105790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:26.044276 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985629-5f61-4782-928b-839bc4105790 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:26.044563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985629-5f61-4782-928b-839bc4105790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:26.044845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb985629-5f61-4782-928b-839bc4105790 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:26.045593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb985629-5f61-4782-928b-839bc4105790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:26.047321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb985629-5f61-4782-928b-839bc4105790 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:26.057888 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1354/2705] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:56:26.061943 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1829534-35c7-4f53-a08f-767c96d2c136 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:26.072832 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1829534-35c7-4f53-a08f-767c96d2c136 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:26.077560 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343c4c4-214f-40c8-9fb5-dabf3c81852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:26.078273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c4c4-214f-40c8-9fb5-dabf3c81852c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:26.078562 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c4c4-214f-40c8-9fb5-dabf3c81852c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:26.078849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343c4c4-214f-40c8-9fb5-dabf3c81852c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:26.079608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343c4c4-214f-40c8-9fb5-dabf3c81852c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:26.081181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343c4c4-214f-40c8-9fb5-dabf3c81852c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:26.091927 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1352/2706] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:56:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:56:26.096343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb985629-5f61-4782-928b-839bc4105790 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:26.106830 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb985629-5f61-4782-928b-839bc4105790 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:26.111671 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf94287-3a8b-4e1e-9a62-bb81ed01df2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:26.112553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf94287-3a8b-4e1e-9a62-bb81ed01df2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:26.112843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf94287-3a8b-4e1e-9a62-bb81ed01df2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:26.113127 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf94287-3a8b-4e1e-9a62-bb81ed01df2a admin admin] PATH_INFO: `/v3/projects/0c2ea80ac0374c2c870a494adc6534ff/users/e03ca4f264eb42ddbe92f5cb95d9fc2f/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:26.129121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf94287-3a8b-4e1e-9a62-bb81ed01df2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c2ea80ac0374c2c870a494adc6534ff, user_id=e03ca4f264eb42ddbe92f5cb95d9fc2f, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:26.131919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf94287-3a8b-4e1e-9a62-bb81ed01df2a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:26.227934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1355/2707] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:56:26 2022] PUT /identity/v3/projects/0c2ea80ac0374c2c870a494adc6534ff/users/e03ca4f264eb42ddbe92f5cb95d9fc2f/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:26.233405 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593fa6e-cb46-4ef5-a0f1-e609a85602f8 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:26.233735 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593fa6e-cb46-4ef5-a0f1-e609a85602f8 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:26.234022 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593fa6e-cb46-4ef5-a0f1-e609a85602f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:26.252452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5593fa6e-cb46-4ef5-a0f1-e609a85602f8 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:26.253680 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5593fa6e-cb46-4ef5-a0f1-e609a85602f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:26.289070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:26.320977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1353/2708] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:26.330985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf94287-3a8b-4e1e-9a62-bb81ed01df2a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:26.332748 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ccf94287-3a8b-4e1e-9a62-bb81ed01df2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:26.393702 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf94287-3a8b-4e1e-9a62-bb81ed01df2a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:26.397328 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c88ae-ffd0-4a9e-9354-5e5ca67804c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:26.398044 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c88ae-ffd0-4a9e-9354-5e5ca67804c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:26.398327 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c88ae-ffd0-4a9e-9354-5e5ca67804c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:26.398607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c88ae-ffd0-4a9e-9354-5e5ca67804c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:26.408285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c88ae-ffd0-4a9e-9354-5e5ca67804c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:26.409805 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c88ae-ffd0-4a9e-9354-5e5ca67804c7 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:26.420948 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1356/2709] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:31.832683 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398573c5-3708-4ae2-bce8-26d7b434411c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:31.833227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398573c5-3708-4ae2-bce8-26d7b434411c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:31.833227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398573c5-3708-4ae2-bce8-26d7b434411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:31.864765 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-398573c5-3708-4ae2-bce8-26d7b434411c None None] MFA Rules not processed for user `e03ca4f264eb42ddbe92f5cb95d9fc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:31.866487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-398573c5-3708-4ae2-bce8-26d7b434411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:31.944797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1354/2710] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:56:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:31.949674 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c88ae-ffd0-4a9e-9354-5e5ca67804c7 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:31.961724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c88ae-ffd0-4a9e-9354-5e5ca67804c7 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:31.966928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e417c-c895-4f26-9123-f271787b078f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:31.967754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e417c-c895-4f26-9123-f271787b078f admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:31.968404 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e417c-c895-4f26-9123-f271787b078f admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:31.968773 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e417c-c895-4f26-9123-f271787b078f admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:31.969846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e417c-c895-4f26-9123-f271787b078f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:31.971891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e417c-c895-4f26-9123-f271787b078f admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:32.093256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1357/2711] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:56:31 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:56:32.097579 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398573c5-3708-4ae2-bce8-26d7b434411c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:32.109885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398573c5-3708-4ae2-bce8-26d7b434411c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:32.175786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec19c8-ae08-49da-ad95-70274b834f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:32.176467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec19c8-ae08-49da-ad95-70274b834f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:32.176757 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec19c8-ae08-49da-ad95-70274b834f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:32.177043 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec19c8-ae08-49da-ad95-70274b834f9e admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:32.177778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec19c8-ae08-49da-ad95-70274b834f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:32.179755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec19c8-ae08-49da-ad95-70274b834f9e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:32.268443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1355/2712] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:56:32 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:56:32.272546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e417c-c895-4f26-9123-f271787b078f admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:32.284063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e417c-c895-4f26-9123-f271787b078f admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:32.288927 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d80750-91e2-443b-ba07-1a0ef4988bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:32.289593 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d80750-91e2-443b-ba07-1a0ef4988bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:32.289943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d80750-91e2-443b-ba07-1a0ef4988bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:32.290227 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d80750-91e2-443b-ba07-1a0ef4988bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:32.291281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d80750-91e2-443b-ba07-1a0ef4988bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:32.292868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d80750-91e2-443b-ba07-1a0ef4988bd2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:32.306200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1358/2713] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:56:32.310434 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec19c8-ae08-49da-ad95-70274b834f9e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:32.321111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec19c8-ae08-49da-ad95-70274b834f9e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:32.326930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d9ab4-c543-4974-8a08-62de91031b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:32.327829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d9ab4-c543-4974-8a08-62de91031b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:32.328126 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d9ab4-c543-4974-8a08-62de91031b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:32.328388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d9ab4-c543-4974-8a08-62de91031b67 admin admin] PATH_INFO: `/v3/projects/71386e31a72f4593b49207e152a5e6a7/users/b1cd1a67116d461f8db90b03aa508a8a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:32.351382 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d9ab4-c543-4974-8a08-62de91031b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71386e31a72f4593b49207e152a5e6a7, user_id=b1cd1a67116d461f8db90b03aa508a8a, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:32.353158 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d9ab4-c543-4974-8a08-62de91031b67 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:32.441015 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1356/2714] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:56:32 2022] PUT /identity/v3/projects/71386e31a72f4593b49207e152a5e6a7/users/b1cd1a67116d461f8db90b03aa508a8a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:32.445908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d80750-91e2-443b-ba07-1a0ef4988bd2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:32.457698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d80750-91e2-443b-ba07-1a0ef4988bd2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:32.516999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ff0aa2-a111-4c41-9503-eb39535833f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:32.517711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff0aa2-a111-4c41-9503-eb39535833f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:32.518006 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff0aa2-a111-4c41-9503-eb39535833f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:32.518285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff0aa2-a111-4c41-9503-eb39535833f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:32.519009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff0aa2-a111-4c41-9503-eb39535833f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:32.520618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ff0aa2-a111-4c41-9503-eb39535833f9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:32.531730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1359/2715] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:56:32.535733 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d9ab4-c543-4974-8a08-62de91031b67 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:32.547727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d9ab4-c543-4974-8a08-62de91031b67 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:32.552739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6845-c274-412d-a9b6-482b3a7b347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:32.553360 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6845-c274-412d-a9b6-482b3a7b347a admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:32.553650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6845-c274-412d-a9b6-482b3a7b347a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:32.554038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891d6845-c274-412d-a9b6-482b3a7b347a admin admin] PATH_INFO: `/v3/projects/71386e31a72f4593b49207e152a5e6a7/users/b1cd1a67116d461f8db90b03aa508a8a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:32.556550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d6845-c274-412d-a9b6-482b3a7b347a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71386e31a72f4593b49207e152a5e6a7, user_id=b1cd1a67116d461f8db90b03aa508a8a, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:32.559262 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891d6845-c274-412d-a9b6-482b3a7b347a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:32.571308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1357/2716] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:56:32 2022] PUT /identity/v3/projects/71386e31a72f4593b49207e152a5e6a7/users/b1cd1a67116d461f8db90b03aa508a8a/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:38.883325 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49f6b0-2f67-4941-b3ac-a4d7bbc1fa3c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:38.884103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49f6b0-2f67-4941-b3ac-a4d7bbc1fa3c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:38.884103 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49f6b0-2f67-4941-b3ac-a4d7bbc1fa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:38.891759 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:38.927846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-9b49f6b0-2f67-4941-b3ac-a4d7bbc1fa3c None None] MFA Rules not processed for user `b1cd1a67116d461f8db90b03aa508a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:38.931448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9b49f6b0-2f67-4941-b3ac-a4d7bbc1fa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:39.043467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1360/2717] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:56:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:39.059180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6845-c274-412d-a9b6-482b3a7b347a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:39.061525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-891d6845-c274-412d-a9b6-482b3a7b347a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:39.096587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:39.164016 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891d6845-c274-412d-a9b6-482b3a7b347a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:39.171037 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca35911-d35e-446c-83b1-3f25b761340f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:39.171037 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca35911-d35e-446c-83b1-3f25b761340f service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:39.171037 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca35911-d35e-446c-83b1-3f25b761340f service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:39.171366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca35911-d35e-446c-83b1-3f25b761340f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:39.242083 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca35911-d35e-446c-83b1-3f25b761340f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:39.243809 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca35911-d35e-446c-83b1-3f25b761340f service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:39.255781 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1358/2718] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:56:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:56:40.315926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49f6b0-2f67-4941-b3ac-a4d7bbc1fa3c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:40.382658 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49f6b0-2f67-4941-b3ac-a4d7bbc1fa3c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:40.387585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd189a-3348-495b-a41c-aadbff327303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:40.388589 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd189a-3348-495b-a41c-aadbff327303 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:40.389090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd189a-3348-495b-a41c-aadbff327303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:40.389550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd189a-3348-495b-a41c-aadbff327303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:40.391828 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2bfd189a-3348-495b-a41c-aadbff327303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:40.404185 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd189a-3348-495b-a41c-aadbff327303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:40.406663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd189a-3348-495b-a41c-aadbff327303 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:40.419722 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1361/2719] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:56:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:42.365511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c1481-1ef2-4fb6-ad96-5e56ca05417f None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:42.366061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c1481-1ef2-4fb6-ad96-5e56ca05417f None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:42.366446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c1481-1ef2-4fb6-ad96-5e56ca05417f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:42.386080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-f58c1481-1ef2-4fb6-ad96-5e56ca05417f None None] MFA Rules not processed for user `e03ca4f264eb42ddbe92f5cb95d9fc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:42.387338 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-f58c1481-1ef2-4fb6-ad96-5e56ca05417f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:42.408662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1359/2720] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:56:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:50.413222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=58 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:52.381689 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=52 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:01.426943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd189a-3348-495b-a41c-aadbff327303 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:01.429229 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2bfd189a-3348-495b-a41c-aadbff327303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:01.548862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd189a-3348-495b-a41c-aadbff327303 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:01.555038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596c4e-d716-40c4-82a4-0e70deecc081 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:01.555228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596c4e-d716-40c4-82a4-0e70deecc081 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:01.555425 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596c4e-d716-40c4-82a4-0e70deecc081 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:01.555707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6596c4e-d716-40c4-82a4-0e70deecc081 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:01.557486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c6596c4e-d716-40c4-82a4-0e70deecc081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:01.569024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6596c4e-d716-40c4-82a4-0e70deecc081 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:01.570682 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6596c4e-d716-40c4-82a4-0e70deecc081 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:01.580447 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1362/2721] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:57:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:11.576286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=54 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:12.099550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c1481-1ef2-4fb6-ad96-5e56ca05417f None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:12.136499 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c1481-1ef2-4fb6-ad96-5e56ca05417f None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:12.143048 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979963d-50c9-48bf-b70d-84f8bc74a781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:12.143833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979963d-50c9-48bf-b70d-84f8bc74a781 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:12.144248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979963d-50c9-48bf-b70d-84f8bc74a781 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:12.144718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979963d-50c9-48bf-b70d-84f8bc74a781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:12.146743 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0979963d-50c9-48bf-b70d-84f8bc74a781 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:12.160164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979963d-50c9-48bf-b70d-84f8bc74a781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:12.161900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979963d-50c9-48bf-b70d-84f8bc74a781 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:12.174755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1360/2722] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:57:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:12.630114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596c4e-d716-40c4-82a4-0e70deecc081 service placement] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:12.631835 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-c6596c4e-d716-40c4-82a4-0e70deecc081 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:12.652446 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6596c4e-d716-40c4-82a4-0e70deecc081 service placement] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:12.657000 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86401d-7e14-4514-805b-92f6faa5add3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:12.657761 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86401d-7e14-4514-805b-92f6faa5add3 service nova] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:12.658117 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86401d-7e14-4514-805b-92f6faa5add3 service nova] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:12.658461 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86401d-7e14-4514-805b-92f6faa5add3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:12.670350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2d86401d-7e14-4514-805b-92f6faa5add3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:12.685625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86401d-7e14-4514-805b-92f6faa5add3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:12.687755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86401d-7e14-4514-805b-92f6faa5add3 service nova] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:12.701397 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1363/2723] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:57:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:14.680868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979963d-50c9-48bf-b70d-84f8bc74a781 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:14.680868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979963d-50c9-48bf-b70d-84f8bc74a781 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:14.680868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a2db-2811-4517-a7d3-8fc605a5de94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:14.680868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a2db-2811-4517-a7d3-8fc605a5de94 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:14.681833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a2db-2811-4517-a7d3-8fc605a5de94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:14.681833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862a2db-2811-4517-a7d3-8fc605a5de94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:14.683461 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862a2db-2811-4517-a7d3-8fc605a5de94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:14.684887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862a2db-2811-4517-a7d3-8fc605a5de94 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:14.694776 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1361/2724] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:57:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:18.500804 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19720cd4-9ac6-4fd4-a69b-d73101cb49c5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:18.501385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19720cd4-9ac6-4fd4-a69b-d73101cb49c5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:18.501385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19720cd4-9ac6-4fd4-a69b-d73101cb49c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:18.524611 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-19720cd4-9ac6-4fd4-a69b-d73101cb49c5 None None] MFA Rules not processed for user `aa52505a079041efbbf14fb04da7ac7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:18.525877 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-19720cd4-9ac6-4fd4-a69b-d73101cb49c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:18.587714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1364/2725] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:57:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:24.690395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=24 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:28.578765 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=31 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:32.393029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a2db-2811-4517-a7d3-8fc605a5de94 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:32.405983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862a2db-2811-4517-a7d3-8fc605a5de94 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:32.411950 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c1381-a682-4467-868b-b9c484ca5599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e4a66515654e1f9f7452740ff4ce58', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:32.412622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1381-a682-4467-868b-b9c484ca5599 service nova] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:32.412916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1381-a682-4467-868b-b9c484ca5599 service nova] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:32.413251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1381-a682-4467-868b-b9c484ca5599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:32.415054 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-df9c1381-a682-4467-868b-b9c484ca5599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:32.427561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c1381-a682-4467-868b-b9c484ca5599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:32.429190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c1381-a682-4467-868b-b9c484ca5599 service nova] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:32.440280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1362/2726] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:57:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:42.436325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:35.173188 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19720cd4-9ac6-4fd4-a69b-d73101cb49c5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:35.174753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-19720cd4-9ac6-4fd4-a69b-d73101cb49c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:35.201086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19720cd4-9ac6-4fd4-a69b-d73101cb49c5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:35.204919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97751983-7a34-4d99-afda-b9addf7cb6a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:35.205576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97751983-7a34-4d99-afda-b9addf7cb6a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:35.205933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97751983-7a34-4d99-afda-b9addf7cb6a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:35.206734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97751983-7a34-4d99-afda-b9addf7cb6a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:35.208455 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-97751983-7a34-4d99-afda-b9addf7cb6a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:35.299432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97751983-7a34-4d99-afda-b9addf7cb6a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:35.300954 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97751983-7a34-4d99-afda-b9addf7cb6a9 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:35.320932 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1365/2727] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:58:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:58:43.381631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c1381-a682-4467-868b-b9c484ca5599 service nova] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:43.383855 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-df9c1381-a682-4467-868b-b9c484ca5599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:43.397851 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c1381-a682-4467-868b-b9c484ca5599 service nova] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:43.402489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:43.403363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:43.403650 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:43.403932 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] PATH_INFO: `/v3/users/b47d51863b0448b880dc03b01dec6dc5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:43.405138 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b47d51863b0448b880dc03b01dec6dc5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:43.407079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:43.582133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b47d51863b0448b880dc03b01dec6dc5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:43.680495 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b47d51863b0448b880dc03b01dec6dc5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:43.681131 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b47d51863b0448b880dc03b01dec6dc5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:43.681833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b47d51863b0448b880dc03b01dec6dc5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:43.694688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b47d51863b0448b880dc03b01dec6dc5'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:43.707045 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1363/2728] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:58:43 2022] DELETE /identity/v3/users/b47d51863b0448b880dc03b01dec6dc5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:43.961483 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97751983-7a34-4d99-afda-b9addf7cb6a9 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:43.972236 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97751983-7a34-4d99-afda-b9addf7cb6a9 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:44.037822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:44.038693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:44.039684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:44.039965 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] PATH_INFO: `/v3/projects/23568023763549669484e71430e34389` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:44.041170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=23568023763549669484e71430e34389)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:44.043139 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:44.174050 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23568023763549669484e71430e34389', 'request_id': 'req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:44.178624 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:44.179844 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23568023763549669484e71430e34389', 'request_id': 'req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:44.185949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23568023763549669484e71430e34389', 'request_id': 'req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:44.247307 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] The token cache is being invalidate because project 23568023763549669484e71430e34389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:58:44.247602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:44.248294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:44.249909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1366/2729] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:58:43 2022] DELETE /identity/v3/projects/23568023763549669484e71430e34389 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:44.253962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:44.255383 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:44.269077 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a1151-6825-43d9-a7f6-3f868da99896 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:44.330496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:44.331454 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:44.331744 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:44.332022 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] PATH_INFO: `/v3/users/dcc7cf39a8144d97b77a0f2166a0e28a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:44.333248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc7cf39a8144d97b77a0f2166a0e28a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:44.335244 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:44.590797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc7cf39a8144d97b77a0f2166a0e28a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:44.668334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc7cf39a8144d97b77a0f2166a0e28a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:44.668993 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc7cf39a8144d97b77a0f2166a0e28a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:44.669615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc7cf39a8144d97b77a0f2166a0e28a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:44.682441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc7cf39a8144d97b77a0f2166a0e28a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:44.684400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:44.697283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1364/2730] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:58:44 2022] DELETE /identity/v3/users/dcc7cf39a8144d97b77a0f2166a0e28a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:44.957484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:44.959011 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:44.973428 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d306eea-e6c5-4fca-8a77-d60c9ade37ce admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:45.031574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:45.032434 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:45.032720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:45.033000 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] PATH_INFO: `/v3/projects/398a9c6b7f384627a1a2397d3d487c23` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:45.034200 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=398a9c6b7f384627a1a2397d3d487c23)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:45.036101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:45.168026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '398a9c6b7f384627a1a2397d3d487c23', 'request_id': 'req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:45.173461 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '398a9c6b7f384627a1a2397d3d487c23', 'request_id': 'req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:45.179691 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '398a9c6b7f384627a1a2397d3d487c23', 'request_id': 'req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:45.258669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] The token cache is being invalidate because project 398a9c6b7f384627a1a2397d3d487c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:58:45.258975 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:45.259582 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:45.261121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1367/2731] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:58:44 2022] DELETE /identity/v3/projects/398a9c6b7f384627a1a2397d3d487c23 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:49.109150 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:49.111971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:49.124522 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feebe41-3ad0-40fd-9bd0-9f60522b42ab admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:49.183343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:49.184153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:49.184439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:49.184718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] PATH_INFO: `/v3/users/aa52505a079041efbbf14fb04da7ac7f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:49.185938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa52505a079041efbbf14fb04da7ac7f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:49.187856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:49.436722 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa52505a079041efbbf14fb04da7ac7f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:49.515773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa52505a079041efbbf14fb04da7ac7f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:49.516403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa52505a079041efbbf14fb04da7ac7f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:49.517019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa52505a079041efbbf14fb04da7ac7f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:49.529898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-c50cd5e1-c3e1-4fbd-a706-97b4a6afad62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa52505a079041efbbf14fb04da7ac7f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:49.542829 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1365/2732] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:58:49 2022] DELETE /identity/v3/users/aa52505a079041efbbf14fb04da7ac7f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:49.800745 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:49.810009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:49.816154 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534fc2f-f80e-4db1-a372-1f0d2a0f8fff admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:49.874935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:49.875826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:49.876094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:49.876375 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] PATH_INFO: `/v3/projects/cbe580a28eae4195be1491ac29d373a7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:49.877586 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe580a28eae4195be1491ac29d373a7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:49.879547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:49.895589 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:49.990690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe580a28eae4195be1491ac29d373a7', 'request_id': 'req-6dc94b51-6c30-41e9-b820-a1aafe03e321'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:49.996017 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe580a28eae4195be1491ac29d373a7', 'request_id': 'req-6dc94b51-6c30-41e9-b820-a1aafe03e321'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:50.002109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe580a28eae4195be1491ac29d373a7', 'request_id': 'req-6dc94b51-6c30-41e9-b820-a1aafe03e321'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:50.046682 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] The token cache is being invalidate because project cbe580a28eae4195be1491ac29d373a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:58:50.046912 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:50.047555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-6dc94b51-6c30-41e9-b820-a1aafe03e321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:50.049248 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1368/2733] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:58:49 2022] DELETE /identity/v3/projects/cbe580a28eae4195be1491ac29d373a7 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:50.054533 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae648-8cce-40da-9ded-3d70a77ef0f1 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:50.054824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae648-8cce-40da-9ded-3d70a77ef0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:50.055110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ae648-8cce-40da-9ded-3d70a77ef0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:50.113449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-681ae648-8cce-40da-9ded-3d70a77ef0f1 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:50.114697 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-681ae648-8cce-40da-9ded-3d70a77ef0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:50.147747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:50.174302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1366/2734] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:58:50.183183 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74eab-a555-4d43-9618-7e32e7340d59 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:50.185608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74eab-a555-4d43-9618-7e32e7340d59 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:50.185608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b74eab-a555-4d43-9618-7e32e7340d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:50.203731 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a8b74eab-a555-4d43-9618-7e32e7340d59 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:50.204959 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a8b74eab-a555-4d43-9618-7e32e7340d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:50.213585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1369/2735] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:50.218255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ae648-8cce-40da-9ded-3d70a77ef0f1 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:50.227885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ae648-8cce-40da-9ded-3d70a77ef0f1 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:50.232441 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdd504-e28b-4934-9fb8-76a0a6503aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:50.233377 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdd504-e28b-4934-9fb8-76a0a6503aae admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:50.233879 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdd504-e28b-4934-9fb8-76a0a6503aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:50.250934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bdd504-e28b-4934-9fb8-76a0a6503aae admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:50.250934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdd504-e28b-4934-9fb8-76a0a6503aae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:58:50.250934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdd504-e28b-4934-9fb8-76a0a6503aae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:50.250934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bdd504-e28b-4934-9fb8-76a0a6503aae admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:50.250934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1367/2736] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:58:50.254093 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b74eab-a555-4d43-9618-7e32e7340d59 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:50.263956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b74eab-a555-4d43-9618-7e32e7340d59 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:50.268778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbb713-93b5-4a06-8037-47c17faba6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:50.269320 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbb713-93b5-4a06-8037-47c17faba6ea admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:50.269607 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbb713-93b5-4a06-8037-47c17faba6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:50.269916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbb713-93b5-4a06-8037-47c17faba6ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:50.270602 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbb713-93b5-4a06-8037-47c17faba6ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:50.272548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbb713-93b5-4a06-8037-47c17faba6ea admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:50.437537 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1370/2737] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:58:50 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:58:50.441751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdd504-e28b-4934-9fb8-76a0a6503aae admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:50.452135 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bdd504-e28b-4934-9fb8-76a0a6503aae admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:50.506881 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ebc78-44b0-41af-9acd-6506d7a8d69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:50.508049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ebc78-44b0-41af-9acd-6506d7a8d69a admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:50.508329 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ebc78-44b0-41af-9acd-6506d7a8d69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:50.508603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ebc78-44b0-41af-9acd-6506d7a8d69a admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:50.509293 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ebc78-44b0-41af-9acd-6506d7a8d69a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:50.511236 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ebc78-44b0-41af-9acd-6506d7a8d69a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:50.619791 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1368/2738] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:58:50 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:58:50.624059 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbb713-93b5-4a06-8037-47c17faba6ea admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:50.635067 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbb713-93b5-4a06-8037-47c17faba6ea admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:50.639684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682838e6-3d8c-43e3-9d12-f801d5528b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:50.640343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682838e6-3d8c-43e3-9d12-f801d5528b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:50.640633 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682838e6-3d8c-43e3-9d12-f801d5528b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:50.640917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682838e6-3d8c-43e3-9d12-f801d5528b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:50.641645 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682838e6-3d8c-43e3-9d12-f801d5528b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:50.643296 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682838e6-3d8c-43e3-9d12-f801d5528b5c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:50.653916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1371/2739] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:58:50.657928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ebc78-44b0-41af-9acd-6506d7a8d69a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:50.668114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ebc78-44b0-41af-9acd-6506d7a8d69a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:50.672741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf827e-ef0d-4e4a-accc-d8d32ec834f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:50.673400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf827e-ef0d-4e4a-accc-d8d32ec834f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:50.673713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf827e-ef0d-4e4a-accc-d8d32ec834f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:50.674036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf827e-ef0d-4e4a-accc-d8d32ec834f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:50.674726 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf827e-ef0d-4e4a-accc-d8d32ec834f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:50.676342 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf827e-ef0d-4e4a-accc-d8d32ec834f4 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:50.687002 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1369/2740] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:58:50.691248 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682838e6-3d8c-43e3-9d12-f801d5528b5c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:50.702109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682838e6-3d8c-43e3-9d12-f801d5528b5c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:50.706780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01986fd5-18fb-4d05-b25a-cce35ed3894c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:50.707661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01986fd5-18fb-4d05-b25a-cce35ed3894c admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:50.707944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01986fd5-18fb-4d05-b25a-cce35ed3894c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:50.708219 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01986fd5-18fb-4d05-b25a-cce35ed3894c admin admin] PATH_INFO: `/v3/projects/75743c90e448491d93a775a0a10bc641/users/8ec88b8b9f3c46e8864e014f7888335b/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:50.723727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01986fd5-18fb-4d05-b25a-cce35ed3894c admin admin] RBAC: Authorizing `identity:create_grant(project_id=75743c90e448491d93a775a0a10bc641, user_id=8ec88b8b9f3c46e8864e014f7888335b, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:50.726594 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01986fd5-18fb-4d05-b25a-cce35ed3894c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:50.824179 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1372/2741] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:58:50 2022] PUT /identity/v3/projects/75743c90e448491d93a775a0a10bc641/users/8ec88b8b9f3c46e8864e014f7888335b/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:50.834510 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11957525-42ea-4d30-90f4-c7018eb3da7c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:50.841238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11957525-42ea-4d30-90f4-c7018eb3da7c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:50.841238 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11957525-42ea-4d30-90f4-c7018eb3da7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:50.862025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-11957525-42ea-4d30-90f4-c7018eb3da7c None None] MFA Rules not processed for user `8ec88b8b9f3c46e8864e014f7888335b`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:50.863251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-11957525-42ea-4d30-90f4-c7018eb3da7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:50.929898 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1370/2742] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:58:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:50.934639 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01986fd5-18fb-4d05-b25a-cce35ed3894c admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:50.999968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01986fd5-18fb-4d05-b25a-cce35ed3894c admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:51.004579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da86db-de6d-4ce7-97cc-bfda29874108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:51.005241 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da86db-de6d-4ce7-97cc-bfda29874108 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:51.005578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da86db-de6d-4ce7-97cc-bfda29874108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:51.005890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da86db-de6d-4ce7-97cc-bfda29874108 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:51.012655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da86db-de6d-4ce7-97cc-bfda29874108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:51.012655 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da86db-de6d-4ce7-97cc-bfda29874108 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:51.083532 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1373/2743] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:58:50 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:58:51.087614 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11957525-42ea-4d30-90f4-c7018eb3da7c None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:51.098648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11957525-42ea-4d30-90f4-c7018eb3da7c None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:51.131177 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:51.154903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b223eb0-4cf0-4b98-9da1-b11687d31fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:51.155569 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b223eb0-4cf0-4b98-9da1-b11687d31fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:51.155955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b223eb0-4cf0-4b98-9da1-b11687d31fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:51.156233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b223eb0-4cf0-4b98-9da1-b11687d31fe1 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:51.156958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b223eb0-4cf0-4b98-9da1-b11687d31fe1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:51.158894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b223eb0-4cf0-4b98-9da1-b11687d31fe1 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:51.248368 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1371/2744] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:58:51 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:58:51.252584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da86db-de6d-4ce7-97cc-bfda29874108 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:51.262996 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da86db-de6d-4ce7-97cc-bfda29874108 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:51.268646 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bc1c7-4e7d-4b1e-8081-e2e89bed81e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:51.269334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bc1c7-4e7d-4b1e-8081-e2e89bed81e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:51.269628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bc1c7-4e7d-4b1e-8081-e2e89bed81e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:51.269951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04bc1c7-4e7d-4b1e-8081-e2e89bed81e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:51.270694 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bc1c7-4e7d-4b1e-8081-e2e89bed81e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:51.272415 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04bc1c7-4e7d-4b1e-8081-e2e89bed81e1 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:51.283513 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1374/2745] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:58:51.287859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b223eb0-4cf0-4b98-9da1-b11687d31fe1 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:51.298816 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b223eb0-4cf0-4b98-9da1-b11687d31fe1 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:51.303756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f337c9-8949-41f7-b7ae-6d0293e728e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:51.305214 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f337c9-8949-41f7-b7ae-6d0293e728e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:51.305501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f337c9-8949-41f7-b7ae-6d0293e728e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:51.305824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f337c9-8949-41f7-b7ae-6d0293e728e5 admin admin] PATH_INFO: `/v3/projects/9d6eace10c9e4e8ca781891748c16543/users/a4a31d47611e4d0992f92168e24a6ba6/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:51.320853 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f337c9-8949-41f7-b7ae-6d0293e728e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6eace10c9e4e8ca781891748c16543, user_id=a4a31d47611e4d0992f92168e24a6ba6, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:51.323549 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f337c9-8949-41f7-b7ae-6d0293e728e5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:51.419964 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1372/2746] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:58:51 2022] PUT /identity/v3/projects/9d6eace10c9e4e8ca781891748c16543/users/a4a31d47611e4d0992f92168e24a6ba6/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:51.424092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bc1c7-4e7d-4b1e-8081-e2e89bed81e1 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:51.434559 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04bc1c7-4e7d-4b1e-8081-e2e89bed81e1 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:51.446156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:51.492014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3cbef-3ad7-4467-88fc-fe0059698e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:51.492689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3cbef-3ad7-4467-88fc-fe0059698e01 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:51.492978 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3cbef-3ad7-4467-88fc-fe0059698e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:51.493259 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3cbef-3ad7-4467-88fc-fe0059698e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:51.494014 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3cbef-3ad7-4467-88fc-fe0059698e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:51.495613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3cbef-3ad7-4467-88fc-fe0059698e01 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:51.505806 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1375/2747] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:58:51.509991 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f337c9-8949-41f7-b7ae-6d0293e728e5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:51.520449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f337c9-8949-41f7-b7ae-6d0293e728e5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:51.525688 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329e458-710e-41d9-87a1-81d3aebca018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:51.526568 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329e458-710e-41d9-87a1-81d3aebca018 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:51.526859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329e458-710e-41d9-87a1-81d3aebca018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:51.527142 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329e458-710e-41d9-87a1-81d3aebca018 admin admin] PATH_INFO: `/v3/projects/9d6eace10c9e4e8ca781891748c16543/users/a4a31d47611e4d0992f92168e24a6ba6/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:51.529105 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329e458-710e-41d9-87a1-81d3aebca018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6eace10c9e4e8ca781891748c16543, user_id=a4a31d47611e4d0992f92168e24a6ba6, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:51.531767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329e458-710e-41d9-87a1-81d3aebca018 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:51.543170 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1373/2748] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:58:51 2022] PUT /identity/v3/projects/9d6eace10c9e4e8ca781891748c16543/users/a4a31d47611e4d0992f92168e24a6ba6/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:51.554458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b56b4-e4f4-4baf-ac11-609f869881fc None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:51.554756 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b56b4-e4f4-4baf-ac11-609f869881fc None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:51.555040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b56b4-e4f4-4baf-ac11-609f869881fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:51.581547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-cd4b56b4-e4f4-4baf-ac11-609f869881fc None None] MFA Rules not processed for user `a4a31d47611e4d0992f92168e24a6ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:51.582821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cd4b56b4-e4f4-4baf-ac11-609f869881fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:51.651549 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1376/2749] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:58:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:51.663202 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329e458-710e-41d9-87a1-81d3aebca018 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:51.665465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1329e458-710e-41d9-87a1-81d3aebca018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:51.743325 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329e458-710e-41d9-87a1-81d3aebca018 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:51.747065 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f8a52-1175-416d-ac08-c10f777f4852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:51.747712 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f8a52-1175-416d-ac08-c10f777f4852 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:51.747999 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f8a52-1175-416d-ac08-c10f777f4852 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:51.748280 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f8a52-1175-416d-ac08-c10f777f4852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:51.758029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f8a52-1175-416d-ac08-c10f777f4852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:51.759385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f8a52-1175-416d-ac08-c10f777f4852 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:51.768755 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1374/2750] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:58:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:58:51.963377 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b56b4-e4f4-4baf-ac11-609f869881fc None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:51.973279 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b56b4-e4f4-4baf-ac11-609f869881fc None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:51.977013 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc90fcf1-7a1e-475a-9eb8-11024349f8e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:51.977690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90fcf1-7a1e-475a-9eb8-11024349f8e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:51.978089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90fcf1-7a1e-475a-9eb8-11024349f8e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:51.978378 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc90fcf1-7a1e-475a-9eb8-11024349f8e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:52.034673 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90fcf1-7a1e-475a-9eb8-11024349f8e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:52.036031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc90fcf1-7a1e-475a-9eb8-11024349f8e8 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:52.044865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1377/2751] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:58:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:01.764620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:02.040803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=84 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:03.643642 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f8a52-1175-416d-ac08-c10f777f4852 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:03.707636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f8a52-1175-416d-ac08-c10f777f4852 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:03.713072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:03.713967 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:03.714249 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:03.714524 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] PATH_INFO: `/v3/users/8ec88b8b9f3c46e8864e014f7888335b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:03.715954 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ec88b8b9f3c46e8864e014f7888335b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:03.717894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:03.884393 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ec88b8b9f3c46e8864e014f7888335b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:03.938223 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ec88b8b9f3c46e8864e014f7888335b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:03.938853 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ec88b8b9f3c46e8864e014f7888335b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:03.939464 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ec88b8b9f3c46e8864e014f7888335b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:03.952837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ec88b8b9f3c46e8864e014f7888335b'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:03.966459 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1375/2752] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:03 2022] DELETE /identity/v3/users/8ec88b8b9f3c46e8864e014f7888335b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:03.970916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02a6c-245d-46a3-965f-7f7e8c4a282c None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:03.975809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02a6c-245d-46a3-965f-7f7e8c4a282c None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:03.975809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02a6c-245d-46a3-965f-7f7e8c4a282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:03.988974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b7b02a6c-245d-46a3-965f-7f7e8c4a282c None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:03.990222 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b7b02a6c-245d-46a3-965f-7f7e8c4a282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:04.049121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1378/2753] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:04.059450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:04.060871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:04.118955 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0236f3-0575-4078-a192-7a3fbf7cf484 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:04.122624 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baef640-70ea-446d-8cef-620f95844c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:04.123269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baef640-70ea-446d-8cef-620f95844c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:04.123556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baef640-70ea-446d-8cef-620f95844c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:04.123838 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baef640-70ea-446d-8cef-620f95844c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:04.133631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baef640-70ea-446d-8cef-620f95844c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:04.135153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baef640-70ea-446d-8cef-620f95844c71 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:04.144561 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1376/2754] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:04.551346 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b02a6c-245d-46a3-965f-7f7e8c4a282c None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:04.552798 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b7b02a6c-245d-46a3-965f-7f7e8c4a282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:04.568306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b02a6c-245d-46a3-965f-7f7e8c4a282c None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:04.572953 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:04.573909 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:04.574133 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:04.574416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] PATH_INFO: `/v3/projects/75743c90e448491d93a775a0a10bc641` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:04.576539 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=75743c90e448491d93a775a0a10bc641)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:04.578601 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:04.710460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75743c90e448491d93a775a0a10bc641', 'request_id': 'req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:04.716153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75743c90e448491d93a775a0a10bc641', 'request_id': 'req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:04.722490 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75743c90e448491d93a775a0a10bc641', 'request_id': 'req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:04.812774 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] The token cache is being invalidate because project 75743c90e448491d93a775a0a10bc641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:04.817302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:04.817302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:04.817302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1379/2755] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:04 2022] DELETE /identity/v3/projects/75743c90e448491d93a775a0a10bc641 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:04.819762 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baef640-70ea-446d-8cef-620f95844c71 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:04.829708 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baef640-70ea-446d-8cef-620f95844c71 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:04.848890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:04.886887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:04.887756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:04.888037 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:04.888311 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] PATH_INFO: `/v3/users/a4a31d47611e4d0992f92168e24a6ba6` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:04.889474 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a31d47611e4d0992f92168e24a6ba6)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:04.891830 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:05.096389 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a31d47611e4d0992f92168e24a6ba6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:05.178802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a31d47611e4d0992f92168e24a6ba6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:05.179515 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a31d47611e4d0992f92168e24a6ba6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:05.180205 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a31d47611e4d0992f92168e24a6ba6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:05.195554 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-24db90d3-0da2-43fb-b568-cad2515898b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a31d47611e4d0992f92168e24a6ba6'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:05.208226 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1377/2756] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:04 2022] DELETE /identity/v3/users/a4a31d47611e4d0992f92168e24a6ba6 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:05.613940 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:05.615406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:05.630681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8abea0-13c0-4837-9758-2eaaac4f1c3b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:05.689109 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:05.690021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:05.690314 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:05.690595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] PATH_INFO: `/v3/projects/9d6eace10c9e4e8ca781891748c16543` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:05.691785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6eace10c9e4e8ca781891748c16543)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:05.693786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:05.774215 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:05.790550 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6eace10c9e4e8ca781891748c16543', 'request_id': 'req-05c045ea-2878-4f21-8409-502caf6d0496'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:05.795917 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6eace10c9e4e8ca781891748c16543', 'request_id': 'req-05c045ea-2878-4f21-8409-502caf6d0496'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:05.802126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6eace10c9e4e8ca781891748c16543', 'request_id': 'req-05c045ea-2878-4f21-8409-502caf6d0496'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:05.898012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] The token cache is being invalidate because project 9d6eace10c9e4e8ca781891748c16543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:05.898237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:05.898833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-05c045ea-2878-4f21-8409-502caf6d0496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:05.900380 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1380/2757] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:05 2022] DELETE /identity/v3/projects/9d6eace10c9e4e8ca781891748c16543 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:05.905288 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954c9f9-c234-4e99-9f54-8cb382d3fcd6 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:05.905856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954c9f9-c234-4e99-9f54-8cb382d3fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:05.905856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954c9f9-c234-4e99-9f54-8cb382d3fcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:05.924075 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d954c9f9-c234-4e99-9f54-8cb382d3fcd6 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:05.925399 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d954c9f9-c234-4e99-9f54-8cb382d3fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:05.988902 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1378/2758] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:05.997542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5eb4-4f56-406c-9122-661713039117 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:05.997865 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5eb4-4f56-406c-9122-661713039117 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:05.998143 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da5eb4-4f56-406c-9122-661713039117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:06.018262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-f9da5eb4-4f56-406c-9122-661713039117 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:06.019522 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-f9da5eb4-4f56-406c-9122-661713039117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:06.027675 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1381/2759] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:06.031934 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954c9f9-c234-4e99-9f54-8cb382d3fcd6 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:06.042168 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954c9f9-c234-4e99-9f54-8cb382d3fcd6 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:06.047100 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e679-e62c-4690-83f5-992731a7a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:06.047857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e679-e62c-4690-83f5-992731a7a422 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:06.048141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e679-e62c-4690-83f5-992731a7a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:06.048418 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4e679-e62c-4690-83f5-992731a7a422 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:06.049140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4e679-e62c-4690-83f5-992731a7a422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:59:06.049449 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4e679-e62c-4690-83f5-992731a7a422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:06.051112 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4e679-e62c-4690-83f5-992731a7a422 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:06.063283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1379/2760] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:59:06.067984 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5eb4-4f56-406c-9122-661713039117 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:06.077383 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da5eb4-4f56-406c-9122-661713039117 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:06.082597 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973744cf-f19a-4d0e-8085-0e08d4c2b084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:06.082859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973744cf-f19a-4d0e-8085-0e08d4c2b084 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:06.083147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973744cf-f19a-4d0e-8085-0e08d4c2b084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:06.083429 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973744cf-f19a-4d0e-8085-0e08d4c2b084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:06.084119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973744cf-f19a-4d0e-8085-0e08d4c2b084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:06.086068 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973744cf-f19a-4d0e-8085-0e08d4c2b084 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:06.243841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1382/2761] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:59:06 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:59:06.247928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e679-e62c-4690-83f5-992731a7a422 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:06.258113 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4e679-e62c-4690-83f5-992731a7a422 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:06.284962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:06.316909 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cb68a-cba6-4c22-b6ed-ba8e8e55e57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:06.317586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cb68a-cba6-4c22-b6ed-ba8e8e55e57c admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:06.317928 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cb68a-cba6-4c22-b6ed-ba8e8e55e57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:06.318213 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cb68a-cba6-4c22-b6ed-ba8e8e55e57c admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:06.318904 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cb68a-cba6-4c22-b6ed-ba8e8e55e57c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:06.320844 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cb68a-cba6-4c22-b6ed-ba8e8e55e57c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:06.438543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1380/2762] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:59:06 2022] POST /identity/v3/users => generated 283 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:06.442650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973744cf-f19a-4d0e-8085-0e08d4c2b084 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:06.453642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973744cf-f19a-4d0e-8085-0e08d4c2b084 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:06.459613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121d88-1eab-45cc-91c0-4a2d72ae0053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:06.463531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121d88-1eab-45cc-91c0-4a2d72ae0053 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:06.463531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121d88-1eab-45cc-91c0-4a2d72ae0053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:06.463531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8121d88-1eab-45cc-91c0-4a2d72ae0053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:06.463531 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8121d88-1eab-45cc-91c0-4a2d72ae0053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:06.464046 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8121d88-1eab-45cc-91c0-4a2d72ae0053 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:06.475096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1383/2763] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:06.479734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cb68a-cba6-4c22-b6ed-ba8e8e55e57c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:06.489931 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cb68a-cba6-4c22-b6ed-ba8e8e55e57c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:06.494694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f53f79-3b0b-4f52-9dd8-22106144d8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:06.495298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f53f79-3b0b-4f52-9dd8-22106144d8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:06.495585 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f53f79-3b0b-4f52-9dd8-22106144d8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:06.495865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f53f79-3b0b-4f52-9dd8-22106144d8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:06.496596 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f53f79-3b0b-4f52-9dd8-22106144d8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:06.498212 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f53f79-3b0b-4f52-9dd8-22106144d8f9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:06.509010 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1381/2764] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:06.513372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121d88-1eab-45cc-91c0-4a2d72ae0053 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:06.524123 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8121d88-1eab-45cc-91c0-4a2d72ae0053 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:06.528650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8aad7-0f6b-45d5-8d08-f11c2cf04b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:06.529516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8aad7-0f6b-45d5-8d08-f11c2cf04b25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:06.529833 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8aad7-0f6b-45d5-8d08-f11c2cf04b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:06.530112 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8aad7-0f6b-45d5-8d08-f11c2cf04b25 admin admin] PATH_INFO: `/v3/projects/307849689a33412eaff55b35579d2dad/users/4d6816114e41438e8a363f426664c9f5/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:06.545344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8aad7-0f6b-45d5-8d08-f11c2cf04b25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=307849689a33412eaff55b35579d2dad, user_id=4d6816114e41438e8a363f426664c9f5, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:06.548038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8aad7-0f6b-45d5-8d08-f11c2cf04b25 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:06.641584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1384/2765] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:06 2022] PUT /identity/v3/projects/307849689a33412eaff55b35579d2dad/users/4d6816114e41438e8a363f426664c9f5/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:59:06.652536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c745f5-f694-4bd3-b992-ac9729ee35bc None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:06.652824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c745f5-f694-4bd3-b992-ac9729ee35bc None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:06.653101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c745f5-f694-4bd3-b992-ac9729ee35bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:06.680853 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-50c745f5-f694-4bd3-b992-ac9729ee35bc None None] MFA Rules not processed for user `4d6816114e41438e8a363f426664c9f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:06.685152 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-50c745f5-f694-4bd3-b992-ac9729ee35bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:06.747659 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1382/2766] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:06.752197 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8aad7-0f6b-45d5-8d08-f11c2cf04b25 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:06.818597 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8aad7-0f6b-45d5-8d08-f11c2cf04b25 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:06.823732 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bb37d-4819-4322-9dc2-4e3ed25542a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:06.824497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bb37d-4819-4322-9dc2-4e3ed25542a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:06.824783 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bb37d-4819-4322-9dc2-4e3ed25542a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:06.825062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89bb37d-4819-4322-9dc2-4e3ed25542a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:06.825780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bb37d-4819-4322-9dc2-4e3ed25542a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:06.827681 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89bb37d-4819-4322-9dc2-4e3ed25542a8 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:06.938033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1385/2767] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:59:06 2022] POST /identity/v3/projects => generated 361 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:06.942144 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c745f5-f694-4bd3-b992-ac9729ee35bc None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:06.953381 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c745f5-f694-4bd3-b992-ac9729ee35bc None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:07.011166 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ad2c5-164b-49e0-998f-c86c61cc7587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:07.012618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ad2c5-164b-49e0-998f-c86c61cc7587 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:07.012618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ad2c5-164b-49e0-998f-c86c61cc7587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:07.012618 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ad2c5-164b-49e0-998f-c86c61cc7587 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:07.013501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ad2c5-164b-49e0-998f-c86c61cc7587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:07.015544 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ad2c5-164b-49e0-998f-c86c61cc7587 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:07.102739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1383/2768] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:59:06 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:07.106695 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bb37d-4819-4322-9dc2-4e3ed25542a8 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:07.117676 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89bb37d-4819-4322-9dc2-4e3ed25542a8 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:07.122324 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c42d2-5804-4766-bb71-69d6206aa050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:07.122985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c42d2-5804-4766-bb71-69d6206aa050 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:07.123282 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c42d2-5804-4766-bb71-69d6206aa050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:07.123560 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c42d2-5804-4766-bb71-69d6206aa050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:07.124281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c42d2-5804-4766-bb71-69d6206aa050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:07.125906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5c42d2-5804-4766-bb71-69d6206aa050 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:07.137389 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1386/2769] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:07.141704 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ad2c5-164b-49e0-998f-c86c61cc7587 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:07.151938 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ad2c5-164b-49e0-998f-c86c61cc7587 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:07.156664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52f2f1-6e31-4082-8617-ef17c3583d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:07.157557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f2f1-6e31-4082-8617-ef17c3583d6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:07.157884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f2f1-6e31-4082-8617-ef17c3583d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:07.158212 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52f2f1-6e31-4082-8617-ef17c3583d6a admin admin] PATH_INFO: `/v3/projects/f97c0366f05041de852065a35fd3ae29/users/a501683b82d249f492a575705e1be6a3/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:07.173756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52f2f1-6e31-4082-8617-ef17c3583d6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97c0366f05041de852065a35fd3ae29, user_id=a501683b82d249f492a575705e1be6a3, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:07.176581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52f2f1-6e31-4082-8617-ef17c3583d6a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:07.259619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1384/2770] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:07 2022] PUT /identity/v3/projects/f97c0366f05041de852065a35fd3ae29/users/a501683b82d249f492a575705e1be6a3/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:07.263688 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c42d2-5804-4766-bb71-69d6206aa050 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:07.274021 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5c42d2-5804-4766-bb71-69d6206aa050 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:07.295023 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:07.331800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014716f-4cb2-4345-a6d7-006bf82efa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:07.332502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014716f-4cb2-4345-a6d7-006bf82efa75 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:07.332790 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014716f-4cb2-4345-a6d7-006bf82efa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:07.333178 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014716f-4cb2-4345-a6d7-006bf82efa75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:07.333937 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014716f-4cb2-4345-a6d7-006bf82efa75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:07.335663 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014716f-4cb2-4345-a6d7-006bf82efa75 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:07.345620 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1387/2771] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:07.350040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52f2f1-6e31-4082-8617-ef17c3583d6a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:07.355676 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:07.361034 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52f2f1-6e31-4082-8617-ef17c3583d6a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:07.365709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1710f-44af-497a-9760-2c28f210423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:07.367217 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1710f-44af-497a-9760-2c28f210423a admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:07.367497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1710f-44af-497a-9760-2c28f210423a admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:07.367773 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1710f-44af-497a-9760-2c28f210423a admin admin] PATH_INFO: `/v3/projects/f97c0366f05041de852065a35fd3ae29/users/a501683b82d249f492a575705e1be6a3/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:07.369746 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1710f-44af-497a-9760-2c28f210423a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97c0366f05041de852065a35fd3ae29, user_id=a501683b82d249f492a575705e1be6a3, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:07.372570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef1710f-44af-497a-9760-2c28f210423a admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:07.383167 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1385/2772] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:07 2022] PUT /identity/v3/projects/f97c0366f05041de852065a35fd3ae29/users/a501683b82d249f492a575705e1be6a3/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:59:07.399031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809357-cf1c-4c8a-a9c9-fb9e47e50f83 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:07.399321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809357-cf1c-4c8a-a9c9-fb9e47e50f83 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:07.399604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe809357-cf1c-4c8a-a9c9-fb9e47e50f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:07.427145 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-fe809357-cf1c-4c8a-a9c9-fb9e47e50f83 None None] MFA Rules not processed for user `a501683b82d249f492a575705e1be6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:07.428372 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fe809357-cf1c-4c8a-a9c9-fb9e47e50f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:07.498160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1388/2773] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:07 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:07.509386 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1710f-44af-497a-9760-2c28f210423a admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:07.511127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2ef1710f-44af-497a-9760-2c28f210423a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:07.570630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1710f-44af-497a-9760-2c28f210423a admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:07.574318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbabc4-b947-4ac8-a1a0-379e752c0dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:07.578316 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbabc4-b947-4ac8-a1a0-379e752c0dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:07.578316 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbabc4-b947-4ac8-a1a0-379e752c0dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:07.578316 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbabc4-b947-4ac8-a1a0-379e752c0dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:07.585335 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbabc4-b947-4ac8-a1a0-379e752c0dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:07.586858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbabc4-b947-4ac8-a1a0-379e752c0dc2 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:07.596662 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1386/2774] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:07 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:07.837267 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe809357-cf1c-4c8a-a9c9-fb9e47e50f83 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:07.847699 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe809357-cf1c-4c8a-a9c9-fb9e47e50f83 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:07.852148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def70de-9d52-41d8-8732-3f041e9e6d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:07.852841 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def70de-9d52-41d8-8732-3f041e9e6d5a service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:07.853116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def70de-9d52-41d8-8732-3f041e9e6d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:07.853401 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def70de-9d52-41d8-8732-3f041e9e6d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:07.909688 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def70de-9d52-41d8-8732-3f041e9e6d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:07.911126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def70de-9d52-41d8-8732-3f041e9e6d5a service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:07.920588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1389/2775] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:10.063811 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbabc4-b947-4ac8-a1a0-379e752c0dc2 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:10.065237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-eacbabc4-b947-4ac8-a1a0-379e752c0dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:10.171243 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbabc4-b947-4ac8-a1a0-379e752c0dc2 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:10.176660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb1fde-e37a-4241-ac40-f51a9369fcb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:10.177337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb1fde-e37a-4241-ac40-f51a9369fcb1 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:10.177620 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb1fde-e37a-4241-ac40-f51a9369fcb1 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:10.177936 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb1fde-e37a-4241-ac40-f51a9369fcb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:10.179795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-ddeb1fde-e37a-4241-ac40-f51a9369fcb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:10.192965 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb1fde-e37a-4241-ac40-f51a9369fcb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:10.194609 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb1fde-e37a-4241-ac40-f51a9369fcb1 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:10.205622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1387/2776] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:11.734096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def70de-9d52-41d8-8732-3f041e9e6d5a service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:11.779213 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=100 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:11.798272 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def70de-9d52-41d8-8732-3f041e9e6d5a service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:11.803085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:11.804001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:11.804283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:11.804557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] PATH_INFO: `/v3/users/4d6816114e41438e8a363f426664c9f5` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:11.805850 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6816114e41438e8a363f426664c9f5)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:11.807809 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:11.997882 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6816114e41438e8a363f426664c9f5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.998492 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6816114e41438e8a363f426664c9f5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.075562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6816114e41438e8a363f426664c9f5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.076186 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6816114e41438e8a363f426664c9f5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.089775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6816114e41438e8a363f426664c9f5'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.102155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1390/2777] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:11 2022] DELETE /identity/v3/users/4d6816114e41438e8a363f426664c9f5 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:12.106763 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59c943-6ed2-4bc1-8b95-70ac80dca6a2 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.107242 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59c943-6ed2-4bc1-8b95-70ac80dca6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.107354 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b59c943-6ed2-4bc1-8b95-70ac80dca6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.124555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-2b59c943-6ed2-4bc1-8b95-70ac80dca6a2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:12.125859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2b59c943-6ed2-4bc1-8b95-70ac80dca6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:12.186802 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1388/2778] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:12.196943 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.206985 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:12.258191 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c826d5-1d09-4d1e-85f5-4bd6601562a3 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.261147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1aaca-cd72-494a-9311-c910bc8c6cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.261834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1aaca-cd72-494a-9311-c910bc8c6cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.262125 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1aaca-cd72-494a-9311-c910bc8c6cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.262407 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1aaca-cd72-494a-9311-c910bc8c6cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.271668 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1aaca-cd72-494a-9311-c910bc8c6cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.273755 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1aaca-cd72-494a-9311-c910bc8c6cc5 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:12.283283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1391/2779] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:12.692369 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59c943-6ed2-4bc1-8b95-70ac80dca6a2 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.693947 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-2b59c943-6ed2-4bc1-8b95-70ac80dca6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:12.702916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:12.708655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b59c943-6ed2-4bc1-8b95-70ac80dca6a2 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.714039 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.714968 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.715246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.719013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] PATH_INFO: `/v3/projects/307849689a33412eaff55b35579d2dad` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.719013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] RBAC: Authorizing `identity:delete_project(project_id=307849689a33412eaff55b35579d2dad)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.719013 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:12.830188 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307849689a33412eaff55b35579d2dad', 'request_id': 'req-4722f032-330b-43a8-a2e2-8443b8ac6049'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.835990 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307849689a33412eaff55b35579d2dad', 'request_id': 'req-4722f032-330b-43a8-a2e2-8443b8ac6049'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.843218 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307849689a33412eaff55b35579d2dad', 'request_id': 'req-4722f032-330b-43a8-a2e2-8443b8ac6049'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.915775 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] The token cache is being invalidate because project 307849689a33412eaff55b35579d2dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:12.916071 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.916697 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.918279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1389/2780] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:12 2022] DELETE /identity/v3/projects/307849689a33412eaff55b35579d2dad => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:12.922445 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1aaca-cd72-494a-9311-c910bc8c6cc5 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.932510 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1aaca-cd72-494a-9311-c910bc8c6cc5 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.987974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.988871 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.989161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.989443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] PATH_INFO: `/v3/users/a501683b82d249f492a575705e1be6a3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.990797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a501683b82d249f492a575705e1be6a3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.993395 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:12.998782 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:13.181015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a501683b82d249f492a575705e1be6a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:13.181689 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a501683b82d249f492a575705e1be6a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:13.269578 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a501683b82d249f492a575705e1be6a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:13.270226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a501683b82d249f492a575705e1be6a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:13.283037 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-c8fa1d21-24eb-429f-ac01-0ee511bc1e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a501683b82d249f492a575705e1be6a3'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:13.295836 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1392/2781] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:12 2022] DELETE /identity/v3/users/a501683b82d249f492a575705e1be6a3 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:13.763169 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:13.767587 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:13.779422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722f032-330b-43a8-a2e2-8443b8ac6049 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:13.846742 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:13.847608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:13.847890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:13.848164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] PATH_INFO: `/v3/projects/f97c0366f05041de852065a35fd3ae29` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:13.849385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97c0366f05041de852065a35fd3ae29)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:13.851400 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:13.968884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97c0366f05041de852065a35fd3ae29', 'request_id': 'req-2912e143-dc1c-43ed-a23d-de4f7036f066'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:13.974901 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97c0366f05041de852065a35fd3ae29', 'request_id': 'req-2912e143-dc1c-43ed-a23d-de4f7036f066'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:13.981523 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97c0366f05041de852065a35fd3ae29', 'request_id': 'req-2912e143-dc1c-43ed-a23d-de4f7036f066'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:14.086714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] The token cache is being invalidate because project f97c0366f05041de852065a35fd3ae29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:14.086714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:14.086714 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-2912e143-dc1c-43ed-a23d-de4f7036f066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:14.087694 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1390/2782] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:13 2022] DELETE /identity/v3/projects/f97c0366f05041de852065a35fd3ae29 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:14.095255 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2d24-1864-4472-b38f-71d8f1ae4079 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.096033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2d24-1864-4472-b38f-71d8f1ae4079 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.096033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2d24-1864-4472-b38f-71d8f1ae4079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.114444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-d10b2d24-1864-4472-b38f-71d8f1ae4079 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:14.115846 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-d10b2d24-1864-4472-b38f-71d8f1ae4079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:14.177854 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1393/2783] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:14.186250 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be6cc4-14bc-40d0-89da-3d24ab9f9621 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.186541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be6cc4-14bc-40d0-89da-3d24ab9f9621 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.186824 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be6cc4-14bc-40d0-89da-3d24ab9f9621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.205785 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e7be6cc4-14bc-40d0-89da-3d24ab9f9621 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:14.206732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e7be6cc4-14bc-40d0-89da-3d24ab9f9621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:14.214975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1391/2784] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:14.219665 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b2d24-1864-4472-b38f-71d8f1ae4079 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:14.230090 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b2d24-1864-4472-b38f-71d8f1ae4079 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:14.237094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18813eb8-fabc-442d-88ef-4d0236a284e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:14.237094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18813eb8-fabc-442d-88ef-4d0236a284e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.237094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18813eb8-fabc-442d-88ef-4d0236a284e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.237094 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18813eb8-fabc-442d-88ef-4d0236a284e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.237754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18813eb8-fabc-442d-88ef-4d0236a284e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:59:14.237754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18813eb8-fabc-442d-88ef-4d0236a284e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:14.239233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18813eb8-fabc-442d-88ef-4d0236a284e6 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:14.255438 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1394/2785] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:59:14.256706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be6cc4-14bc-40d0-89da-3d24ab9f9621 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:14.266052 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be6cc4-14bc-40d0-89da-3d24ab9f9621 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:14.270715 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a051e-d990-4ac8-b7fc-34cf2801de6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:14.271367 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a051e-d990-4ac8-b7fc-34cf2801de6c admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.271704 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a051e-d990-4ac8-b7fc-34cf2801de6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.271926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a051e-d990-4ac8-b7fc-34cf2801de6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.272648 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a051e-d990-4ac8-b7fc-34cf2801de6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:14.274655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a051e-d990-4ac8-b7fc-34cf2801de6c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:14.279327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:14.391738 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1392/2786] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:59:14 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:14.396015 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18813eb8-fabc-442d-88ef-4d0236a284e6 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:14.406618 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18813eb8-fabc-442d-88ef-4d0236a284e6 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:14.465988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb120b-0c9a-4918-810a-190faeac5abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:14.466667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb120b-0c9a-4918-810a-190faeac5abf admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.466956 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb120b-0c9a-4918-810a-190faeac5abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.467235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb120b-0c9a-4918-810a-190faeac5abf admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.467930 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb120b-0c9a-4918-810a-190faeac5abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:14.469882 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb120b-0c9a-4918-810a-190faeac5abf admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:14.578486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1395/2787] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:59:14 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:14.582489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a051e-d990-4ac8-b7fc-34cf2801de6c admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:14.593788 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a051e-d990-4ac8-b7fc-34cf2801de6c admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:14.598373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145a53d-3f10-46e8-8612-f44f2b5f31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:14.599036 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145a53d-3f10-46e8-8612-f44f2b5f31f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.599324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145a53d-3f10-46e8-8612-f44f2b5f31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.599607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145a53d-3f10-46e8-8612-f44f2b5f31f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.600334 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145a53d-3f10-46e8-8612-f44f2b5f31f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:14.602685 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145a53d-3f10-46e8-8612-f44f2b5f31f7 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:14.612769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1393/2788] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:14.621736 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb120b-0c9a-4918-810a-190faeac5abf admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:14.626949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:14.632199 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb120b-0c9a-4918-810a-190faeac5abf admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:14.636829 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2877f1b-3ae2-4603-b840-f10b45aa4626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:14.637487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2877f1b-3ae2-4603-b840-f10b45aa4626 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.637813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2877f1b-3ae2-4603-b840-f10b45aa4626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.638101 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2877f1b-3ae2-4603-b840-f10b45aa4626 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.638823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2877f1b-3ae2-4603-b840-f10b45aa4626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:14.640442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2877f1b-3ae2-4603-b840-f10b45aa4626 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:14.651728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1396/2789] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:14.655951 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145a53d-3f10-46e8-8612-f44f2b5f31f7 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:14.666727 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145a53d-3f10-46e8-8612-f44f2b5f31f7 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:14.671333 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946adf54-8d21-425a-9849-d1084a2d8482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:14.676460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946adf54-8d21-425a-9849-d1084a2d8482 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.676460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946adf54-8d21-425a-9849-d1084a2d8482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.676460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946adf54-8d21-425a-9849-d1084a2d8482 admin admin] PATH_INFO: `/v3/projects/f89e0c41647c4b58bbf0f542d125d523/users/d63c4401794c464c838c6348e42af7db/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.687476 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946adf54-8d21-425a-9849-d1084a2d8482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f89e0c41647c4b58bbf0f542d125d523, user_id=d63c4401794c464c838c6348e42af7db, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:14.690227 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946adf54-8d21-425a-9849-d1084a2d8482 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:14.753472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1394/2790] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:14 2022] PUT /identity/v3/projects/f89e0c41647c4b58bbf0f542d125d523/users/d63c4401794c464c838c6348e42af7db/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:14.763867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9f0de-1c36-42c2-a3d2-883c5fffa099 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.764157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9f0de-1c36-42c2-a3d2-883c5fffa099 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.764432 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9f0de-1c36-42c2-a3d2-883c5fffa099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.792216 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-6bb9f0de-1c36-42c2-a3d2-883c5fffa099 None None] MFA Rules not processed for user `d63c4401794c464c838c6348e42af7db`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:14.793444 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6bb9f0de-1c36-42c2-a3d2-883c5fffa099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:14.857269 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1397/2791] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:14 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:14.861709 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946adf54-8d21-425a-9849-d1084a2d8482 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:14.924185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946adf54-8d21-425a-9849-d1084a2d8482 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:14.929061 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cbd2-2624-472c-b248-1d076628eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:14.929768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cbd2-2624-472c-b248-1d076628eb96 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.930041 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cbd2-2624-472c-b248-1d076628eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.930318 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7cbd2-2624-472c-b248-1d076628eb96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.931000 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7cbd2-2624-472c-b248-1d076628eb96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:14.932940 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7cbd2-2624-472c-b248-1d076628eb96 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:15.029741 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1395/2792] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:59:14 2022] POST /identity/v3/projects => generated 365 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:15.033887 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9f0de-1c36-42c2-a3d2-883c5fffa099 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:15.045928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9f0de-1c36-42c2-a3d2-883c5fffa099 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:15.107367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f44570-51fa-4d8a-af79-aeaef7dcc923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:15.108032 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44570-51fa-4d8a-af79-aeaef7dcc923 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:15.108225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44570-51fa-4d8a-af79-aeaef7dcc923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:15.108503 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f44570-51fa-4d8a-af79-aeaef7dcc923 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:15.109201 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f44570-51fa-4d8a-af79-aeaef7dcc923 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:15.111147 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f44570-51fa-4d8a-af79-aeaef7dcc923 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:15.222256 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1398/2793] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:59:15 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:15.226810 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cbd2-2624-472c-b248-1d076628eb96 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:15.237240 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7cbd2-2624-472c-b248-1d076628eb96 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:15.242529 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53142c-e512-4eb7-9e43-4bb76c53c351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:15.243191 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53142c-e512-4eb7-9e43-4bb76c53c351 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:15.243484 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53142c-e512-4eb7-9e43-4bb76c53c351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:15.243767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53142c-e512-4eb7-9e43-4bb76c53c351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:15.244497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53142c-e512-4eb7-9e43-4bb76c53c351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:15.246146 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53142c-e512-4eb7-9e43-4bb76c53c351 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:15.256976 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1396/2794] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:15.265717 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f44570-51fa-4d8a-af79-aeaef7dcc923 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:15.275776 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f44570-51fa-4d8a-af79-aeaef7dcc923 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:15.280427 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1e8ef-4ea9-456a-a992-39d14a7b0253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:15.281302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1e8ef-4ea9-456a-a992-39d14a7b0253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:15.281587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1e8ef-4ea9-456a-a992-39d14a7b0253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:15.281895 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1e8ef-4ea9-456a-a992-39d14a7b0253 admin admin] PATH_INFO: `/v3/projects/1e2f121595c641128eaf35e3cdc3516a/users/12a207d2f0d7415ab01b705882bf23ec/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:15.296834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1e8ef-4ea9-456a-a992-39d14a7b0253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2f121595c641128eaf35e3cdc3516a, user_id=12a207d2f0d7415ab01b705882bf23ec, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:15.299584 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d1e8ef-4ea9-456a-a992-39d14a7b0253 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:15.400092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1399/2795] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:15 2022] PUT /identity/v3/projects/1e2f121595c641128eaf35e3cdc3516a/users/12a207d2f0d7415ab01b705882bf23ec/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:15.404255 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53142c-e512-4eb7-9e43-4bb76c53c351 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:15.414933 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53142c-e512-4eb7-9e43-4bb76c53c351 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:15.473427 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28228b3b-7cbb-4f8e-80cf-7b93cceaf836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:15.474137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28228b3b-7cbb-4f8e-80cf-7b93cceaf836 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:15.474453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28228b3b-7cbb-4f8e-80cf-7b93cceaf836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:15.474739 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28228b3b-7cbb-4f8e-80cf-7b93cceaf836 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:15.475467 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28228b3b-7cbb-4f8e-80cf-7b93cceaf836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:15.477657 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28228b3b-7cbb-4f8e-80cf-7b93cceaf836 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:15.487692 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1397/2796] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:59:15.492008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1e8ef-4ea9-456a-a992-39d14a7b0253 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:15.502409 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1e8ef-4ea9-456a-a992-39d14a7b0253 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:15.507467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb1d47-a976-4841-b85b-9159cda51528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:15.508352 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1d47-a976-4841-b85b-9159cda51528 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:15.508638 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1d47-a976-4841-b85b-9159cda51528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:15.508916 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb1d47-a976-4841-b85b-9159cda51528 admin admin] PATH_INFO: `/v3/projects/1e2f121595c641128eaf35e3cdc3516a/users/12a207d2f0d7415ab01b705882bf23ec/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:15.510914 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb1d47-a976-4841-b85b-9159cda51528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2f121595c641128eaf35e3cdc3516a, user_id=12a207d2f0d7415ab01b705882bf23ec, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:15.513553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb1d47-a976-4841-b85b-9159cda51528 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:15.525595 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1400/2797] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:15 2022] PUT /identity/v3/projects/1e2f121595c641128eaf35e3cdc3516a/users/12a207d2f0d7415ab01b705882bf23ec/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:15.536812 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b89a64-8505-4b10-a112-44d58a3b48df None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:15.537110 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b89a64-8505-4b10-a112-44d58a3b48df None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:15.537396 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b89a64-8505-4b10-a112-44d58a3b48df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:15.563852 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b5b89a64-8505-4b10-a112-44d58a3b48df None None] MFA Rules not processed for user `12a207d2f0d7415ab01b705882bf23ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:15.565072 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b5b89a64-8505-4b10-a112-44d58a3b48df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:15.574294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:15.634265 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1398/2798] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:15.645915 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb1d47-a976-4841-b85b-9159cda51528 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:15.648160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-6ecb1d47-a976-4841-b85b-9159cda51528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:15.683300 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:15.705857 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb1d47-a976-4841-b85b-9159cda51528 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:15.710786 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ce77a-8ac5-4408-a8b4-e20935cfdc76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:15.711487 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ce77a-8ac5-4408-a8b4-e20935cfdc76 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:15.711849 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ce77a-8ac5-4408-a8b4-e20935cfdc76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:15.712128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ce77a-8ac5-4408-a8b4-e20935cfdc76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:15.723244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ce77a-8ac5-4408-a8b4-e20935cfdc76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:15.724728 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ce77a-8ac5-4408-a8b4-e20935cfdc76 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:15.734740 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1401/2799] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:15.958154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b89a64-8505-4b10-a112-44d58a3b48df None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:15.975684 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b89a64-8505-4b10-a112-44d58a3b48df None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:15.979233 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b2fd4-b715-402e-bd7a-1c4e14e222a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:15.979910 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2fd4-b715-402e-bd7a-1c4e14e222a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:15.980220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2fd4-b715-402e-bd7a-1c4e14e222a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:15.980578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2fd4-b715-402e-bd7a-1c4e14e222a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:16.041619 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b2fd4-b715-402e-bd7a-1c4e14e222a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:16.043093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b2fd4-b715-402e-bd7a-1c4e14e222a1 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:16.052414 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1399/2800] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:15 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:22.762385 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ce77a-8ac5-4408-a8b4-e20935cfdc76 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:22.826884 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ce77a-8ac5-4408-a8b4-e20935cfdc76 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:22.831399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:22.832359 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:22.832650 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:22.832928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] PATH_INFO: `/v3/users/d63c4401794c464c838c6348e42af7db` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:22.834153 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63c4401794c464c838c6348e42af7db)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:22.836095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:23.006610 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63c4401794c464c838c6348e42af7db'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:23.007193 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63c4401794c464c838c6348e42af7db'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:23.107345 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63c4401794c464c838c6348e42af7db'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:23.107981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63c4401794c464c838c6348e42af7db'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:23.121225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63c4401794c464c838c6348e42af7db'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:23.133548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1402/2801] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:22 2022] DELETE /identity/v3/users/d63c4401794c464c838c6348e42af7db => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:23.138118 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6663e-4b81-423d-aa31-7be84e8291bb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:23.138660 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6663e-4b81-423d-aa31-7be84e8291bb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:23.138770 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6663e-4b81-423d-aa31-7be84e8291bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:23.155693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-7fa6663e-4b81-423d-aa31-7be84e8291bb None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:23.156916 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7fa6663e-4b81-423d-aa31-7be84e8291bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:23.221771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1400/2802] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:23.231723 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:23.233167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:23.290669 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba6d08-f907-40b9-99aa-3b1493fe3767 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:23.294670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822ec4a-a08e-41e4-b35b-5c9579f3ee66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:23.295334 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ec4a-a08e-41e4-b35b-5c9579f3ee66 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:23.295623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ec4a-a08e-41e4-b35b-5c9579f3ee66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:23.295928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822ec4a-a08e-41e4-b35b-5c9579f3ee66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:23.305764 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822ec4a-a08e-41e4-b35b-5c9579f3ee66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:23.307248 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822ec4a-a08e-41e4-b35b-5c9579f3ee66 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:23.311440 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:23.317590 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1403/2803] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:23.824208 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6663e-4b81-423d-aa31-7be84e8291bb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:23.828309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7fa6663e-4b81-423d-aa31-7be84e8291bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:23.838122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6663e-4b81-423d-aa31-7be84e8291bb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:23.843219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:23.845087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:23.845378 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:23.845655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] PATH_INFO: `/v3/projects/f89e0c41647c4b58bbf0f542d125d523` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:23.847025 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f89e0c41647c4b58bbf0f542d125d523)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:23.849525 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:23.948201 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:23.954182 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f89e0c41647c4b58bbf0f542d125d523', 'request_id': 'req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:23.959591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f89e0c41647c4b58bbf0f542d125d523', 'request_id': 'req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:23.966460 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f89e0c41647c4b58bbf0f542d125d523', 'request_id': 'req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:24.016106 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] The token cache is being invalidate because project f89e0c41647c4b58bbf0f542d125d523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:24.016471 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:24.017219 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:24.019004 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1401/2804] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:23 2022] DELETE /identity/v3/projects/f89e0c41647c4b58bbf0f542d125d523 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:24.023788 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822ec4a-a08e-41e4-b35b-5c9579f3ee66 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:24.034443 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822ec4a-a08e-41e4-b35b-5c9579f3ee66 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:24.091630 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:24.092536 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:24.092821 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:24.093102 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] PATH_INFO: `/v3/users/12a207d2f0d7415ab01b705882bf23ec` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:24.094306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a207d2f0d7415ab01b705882bf23ec)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:24.096239 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:24.262160 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a207d2f0d7415ab01b705882bf23ec'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:24.262826 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a207d2f0d7415ab01b705882bf23ec'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:24.400904 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a207d2f0d7415ab01b705882bf23ec'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:24.401575 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a207d2f0d7415ab01b705882bf23ec'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:24.415026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-846a8259-a935-4660-afcf-171ea9970834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a207d2f0d7415ab01b705882bf23ec'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:24.427263 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1404/2805] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:24 2022] DELETE /identity/v3/users/12a207d2f0d7415ab01b705882bf23ec => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:59:24.876477 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:24.878009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:24.892289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed65aa4-1a3d-426c-abf8-60d5bf7c9719 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:24.950888 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:24.951768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:24.952040 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:24.952321 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] PATH_INFO: `/v3/projects/1e2f121595c641128eaf35e3cdc3516a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:24.953506 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2f121595c641128eaf35e3cdc3516a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:24.955512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:25.085631 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2f121595c641128eaf35e3cdc3516a', 'request_id': 'req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:25.091686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2f121595c641128eaf35e3cdc3516a', 'request_id': 'req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:25.097882 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2f121595c641128eaf35e3cdc3516a', 'request_id': 'req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:25.187268 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] The token cache is being invalidate because project 1e2f121595c641128eaf35e3cdc3516a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:25.187496 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:25.188125 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-d61f4f7c-46a2-45e0-a1e8-7cd8d427ff43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:25.189747 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1402/2806] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:24 2022] DELETE /identity/v3/projects/1e2f121595c641128eaf35e3cdc3516a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:25.194579 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13d446-43c6-49af-a785-f77a108fcba5 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:25.195062 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13d446-43c6-49af-a785-f77a108fcba5 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:25.195173 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13d446-43c6-49af-a785-f77a108fcba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:25.212973 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-1b13d446-43c6-49af-a785-f77a108fcba5 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:25.214226 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1b13d446-43c6-49af-a785-f77a108fcba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:25.275380 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1405/2807] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:25.283279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bea73a-e525-4513-82a2-0d32f129ffb9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:25.283575 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bea73a-e525-4513-82a2-0d32f129ffb9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:25.283859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bea73a-e525-4513-82a2-0d32f129ffb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:25.303049 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-d2bea73a-e525-4513-82a2-0d32f129ffb9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:25.304833 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-d2bea73a-e525-4513-82a2-0d32f129ffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:25.312883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1403/2808] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:59:25.317136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13d446-43c6-49af-a785-f77a108fcba5 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:25.327230 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13d446-43c6-49af-a785-f77a108fcba5 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:25.331913 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307e0cd-043b-465a-96f9-96e6d083af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:25.332568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e0cd-043b-465a-96f9-96e6d083af70 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:25.332859 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e0cd-043b-465a-96f9-96e6d083af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:25.333142 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307e0cd-043b-465a-96f9-96e6d083af70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:25.333934 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307e0cd-043b-465a-96f9-96e6d083af70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:59:25.334248 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307e0cd-043b-465a-96f9-96e6d083af70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:25.335949 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307e0cd-043b-465a-96f9-96e6d083af70 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:25.347890 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1406/2809] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:59:25.352713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bea73a-e525-4513-82a2-0d32f129ffb9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:25.362115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bea73a-e525-4513-82a2-0d32f129ffb9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:25.367328 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241afce-cfe7-435b-b2b8-7cb92c77bc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:25.367977 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241afce-cfe7-435b-b2b8-7cb92c77bc46 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:25.368269 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241afce-cfe7-435b-b2b8-7cb92c77bc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:25.368550 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241afce-cfe7-435b-b2b8-7cb92c77bc46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:25.369246 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241afce-cfe7-435b-b2b8-7cb92c77bc46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:25.371179 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241afce-cfe7-435b-b2b8-7cb92c77bc46 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:25.477634 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1404/2810] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:59:25 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:59:25.481816 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307e0cd-043b-465a-96f9-96e6d083af70 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:25.488525 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:25.492304 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307e0cd-043b-465a-96f9-96e6d083af70 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:25.551568 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372304-2dcc-408e-ba3a-89bacd12e3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:25.552261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372304-2dcc-408e-ba3a-89bacd12e3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:25.552553 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372304-2dcc-408e-ba3a-89bacd12e3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:25.552834 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372304-2dcc-408e-ba3a-89bacd12e3c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:25.553558 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53372304-2dcc-408e-ba3a-89bacd12e3c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:25.555556 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53372304-2dcc-408e-ba3a-89bacd12e3c5 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:25.709554 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1407/2811] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:59:25 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:25.714286 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241afce-cfe7-435b-b2b8-7cb92c77bc46 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:25.724718 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241afce-cfe7-435b-b2b8-7cb92c77bc46 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:25.730093 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218ec9f-b807-420a-a1bc-8540e512a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:25.730701 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218ec9f-b807-420a-a1bc-8540e512a717 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:25.731195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218ec9f-b807-420a-a1bc-8540e512a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:25.731475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218ec9f-b807-420a-a1bc-8540e512a717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:25.732237 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218ec9f-b807-420a-a1bc-8540e512a717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:25.733856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218ec9f-b807-420a-a1bc-8540e512a717 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:25.744497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1405/2812] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:59:25.748467 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372304-2dcc-408e-ba3a-89bacd12e3c5 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:25.758886 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372304-2dcc-408e-ba3a-89bacd12e3c5 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:25.763562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75394522-132c-45dc-8395-5dcaab928f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:25.764253 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394522-132c-45dc-8395-5dcaab928f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:25.764542 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394522-132c-45dc-8395-5dcaab928f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:25.764822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75394522-132c-45dc-8395-5dcaab928f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:25.765541 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75394522-132c-45dc-8395-5dcaab928f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:25.767167 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75394522-132c-45dc-8395-5dcaab928f68 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:25.777733 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1408/2813] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:25.781871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218ec9f-b807-420a-a1bc-8540e512a717 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:25.792667 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218ec9f-b807-420a-a1bc-8540e512a717 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:25.797156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc946f-065e-40a7-9f21-39de9cee62e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:25.798079 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc946f-065e-40a7-9f21-39de9cee62e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:25.798372 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc946f-065e-40a7-9f21-39de9cee62e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:25.798654 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc946f-065e-40a7-9f21-39de9cee62e9 admin admin] PATH_INFO: `/v3/projects/d7ae0216af674f65bcebc90679d1d0df/users/5a92fb271520414c878654012a2be4bb/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:25.813044 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc946f-065e-40a7-9f21-39de9cee62e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7ae0216af674f65bcebc90679d1d0df, user_id=5a92fb271520414c878654012a2be4bb, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:25.815865 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc946f-065e-40a7-9f21-39de9cee62e9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:25.819769 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:25.932926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1406/2814] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:25 2022] PUT /identity/v3/projects/d7ae0216af674f65bcebc90679d1d0df/users/5a92fb271520414c878654012a2be4bb/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:25.944884 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6967-2603-4673-9cbc-9db9c49a5ce9 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:25.945177 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6967-2603-4673-9cbc-9db9c49a5ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:25.945460 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6967-2603-4673-9cbc-9db9c49a5ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:25.980001 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-22bc6967-2603-4673-9cbc-9db9c49a5ce9 None None] MFA Rules not processed for user `5a92fb271520414c878654012a2be4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:25.981281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-22bc6967-2603-4673-9cbc-9db9c49a5ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:26.046537 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1409/2815] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:26.051190 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc946f-065e-40a7-9f21-39de9cee62e9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:26.115275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc946f-065e-40a7-9f21-39de9cee62e9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:26.120337 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d4dd0-8974-4e36-939a-d3e4d39f7546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:26.121004 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d4dd0-8974-4e36-939a-d3e4d39f7546 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:26.121298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d4dd0-8974-4e36-939a-d3e4d39f7546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:26.121582 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d4dd0-8974-4e36-939a-d3e4d39f7546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:26.122362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d4dd0-8974-4e36-939a-d3e4d39f7546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:26.124283 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d4dd0-8974-4e36-939a-d3e4d39f7546 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:26.197892 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1407/2816] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:59:26 2022] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:26.201780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc6967-2603-4673-9cbc-9db9c49a5ce9 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:26.214135 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc6967-2603-4673-9cbc-9db9c49a5ce9 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:26.271993 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e43595-5e0c-4f77-8551-bb36e6e89281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:26.272591 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e43595-5e0c-4f77-8551-bb36e6e89281 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:26.272883 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e43595-5e0c-4f77-8551-bb36e6e89281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:26.273166 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e43595-5e0c-4f77-8551-bb36e6e89281 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:26.274027 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e43595-5e0c-4f77-8551-bb36e6e89281 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:26.275977 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e43595-5e0c-4f77-8551-bb36e6e89281 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:26.387897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1410/2817] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:59:26 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:26.389323 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d4dd0-8974-4e36-939a-d3e4d39f7546 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:26.400356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d4dd0-8974-4e36-939a-d3e4d39f7546 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:26.405366 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e77fe-ef2c-4458-9fa6-43a3f756de34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:26.406073 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e77fe-ef2c-4458-9fa6-43a3f756de34 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:26.406362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e77fe-ef2c-4458-9fa6-43a3f756de34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:26.406644 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e77fe-ef2c-4458-9fa6-43a3f756de34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:26.407406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e77fe-ef2c-4458-9fa6-43a3f756de34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:26.409029 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e77fe-ef2c-4458-9fa6-43a3f756de34 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:26.421390 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1408/2818] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:26.433988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e43595-5e0c-4f77-8551-bb36e6e89281 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:26.439116 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:26.445333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e43595-5e0c-4f77-8551-bb36e6e89281 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:26.450243 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf95e90-704b-4bda-b69a-2bb4b48000d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:26.451262 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95e90-704b-4bda-b69a-2bb4b48000d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:26.451555 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95e90-704b-4bda-b69a-2bb4b48000d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:26.451840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95e90-704b-4bda-b69a-2bb4b48000d2 admin admin] PATH_INFO: `/v3/projects/bc5fd52fd3994532b443e6fa0265822b/users/1a8e7d576bbc4bba9a22fe426be85d5f/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:26.468893 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf95e90-704b-4bda-b69a-2bb4b48000d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5fd52fd3994532b443e6fa0265822b, user_id=1a8e7d576bbc4bba9a22fe426be85d5f, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:26.471848 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf95e90-704b-4bda-b69a-2bb4b48000d2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:26.580986 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1411/2819] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:26 2022] PUT /identity/v3/projects/bc5fd52fd3994532b443e6fa0265822b/users/1a8e7d576bbc4bba9a22fe426be85d5f/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:26.590926 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e77fe-ef2c-4458-9fa6-43a3f756de34 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:26.597493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e77fe-ef2c-4458-9fa6-43a3f756de34 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:26.657868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c59a97-aecd-4746-af56-6410e234e929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:26.658637 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c59a97-aecd-4746-af56-6410e234e929 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:26.658858 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c59a97-aecd-4746-af56-6410e234e929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:26.659108 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c59a97-aecd-4746-af56-6410e234e929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:26.659826 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c59a97-aecd-4746-af56-6410e234e929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:26.661849 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c59a97-aecd-4746-af56-6410e234e929 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:26.672578 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1409/2820] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:26.676910 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf95e90-704b-4bda-b69a-2bb4b48000d2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:26.688008 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf95e90-704b-4bda-b69a-2bb4b48000d2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:26.692613 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703168d-f6e8-4def-b0e6-9f7abc2550db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:26.693498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703168d-f6e8-4def-b0e6-9f7abc2550db admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:26.693823 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703168d-f6e8-4def-b0e6-9f7abc2550db admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:26.694730 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703168d-f6e8-4def-b0e6-9f7abc2550db admin admin] PATH_INFO: `/v3/projects/bc5fd52fd3994532b443e6fa0265822b/users/1a8e7d576bbc4bba9a22fe426be85d5f/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:26.696775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703168d-f6e8-4def-b0e6-9f7abc2550db admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc5fd52fd3994532b443e6fa0265822b, user_id=1a8e7d576bbc4bba9a22fe426be85d5f, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:26.699502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703168d-f6e8-4def-b0e6-9f7abc2550db admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:26.711693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1412/2821] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:26 2022] PUT /identity/v3/projects/bc5fd52fd3994532b443e6fa0265822b/users/1a8e7d576bbc4bba9a22fe426be85d5f/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:59:26.723086 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0e7c5-09e4-42fb-99da-518aa4f14c96 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:26.723387 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0e7c5-09e4-42fb-99da-518aa4f14c96 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:26.723673 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0e7c5-09e4-42fb-99da-518aa4f14c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:26.751847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-55b0e7c5-09e4-42fb-99da-518aa4f14c96 None None] MFA Rules not processed for user `1a8e7d576bbc4bba9a22fe426be85d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:26.753153 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-55b0e7c5-09e4-42fb-99da-518aa4f14c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:26.810267 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:26.825842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1410/2822] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:26.837437 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703168d-f6e8-4def-b0e6-9f7abc2550db admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:26.839316 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-9703168d-f6e8-4def-b0e6-9f7abc2550db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:26.905012 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703168d-f6e8-4def-b0e6-9f7abc2550db admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:26.908858 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aa049-9d5c-4bff-a34c-f9b3793e89b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:26.909698 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aa049-9d5c-4bff-a34c-f9b3793e89b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:26.909866 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aa049-9d5c-4bff-a34c-f9b3793e89b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:26.910136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640aa049-9d5c-4bff-a34c-f9b3793e89b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:26.973998 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aa049-9d5c-4bff-a34c-f9b3793e89b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:26.976126 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640aa049-9d5c-4bff-a34c-f9b3793e89b3 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:26.986087 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1413/2823] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:30.053771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0e7c5-09e4-42fb-99da-518aa4f14c96 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:30.116923 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0e7c5-09e4-42fb-99da-518aa4f14c96 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:30.121485 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:30.122385 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:30.122672 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:30.122953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] PATH_INFO: `/v3/users/5a92fb271520414c878654012a2be4bb` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:30.124175 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a92fb271520414c878654012a2be4bb)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:30.126130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:30.361754 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aa049-9d5c-4bff-a34c-f9b3793e89b3 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:30.363240 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-640aa049-9d5c-4bff-a34c-f9b3793e89b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:30.424086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640aa049-9d5c-4bff-a34c-f9b3793e89b3 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:30.428604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73043c3-d0c7-46f8-8e3a-efd471f0cf6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:30.429260 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73043c3-d0c7-46f8-8e3a-efd471f0cf6e service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:30.429677 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73043c3-d0c7-46f8-8e3a-efd471f0cf6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:30.429974 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73043c3-d0c7-46f8-8e3a-efd471f0cf6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:30.430343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a92fb271520414c878654012a2be4bb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:30.431797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b73043c3-d0c7-46f8-8e3a-efd471f0cf6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:30.441891 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73043c3-d0c7-46f8-8e3a-efd471f0cf6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:30.447894 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73043c3-d0c7-46f8-8e3a-efd471f0cf6e service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:30.452302 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1414/2824] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:59:30.536007 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a92fb271520414c878654012a2be4bb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:30.536670 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a92fb271520414c878654012a2be4bb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:30.537291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a92fb271520414c878654012a2be4bb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:30.550509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a92fb271520414c878654012a2be4bb'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:30.562887 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1411/2825] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:30 2022] DELETE /identity/v3/users/5a92fb271520414c878654012a2be4bb => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:30.567727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5ba5a-8351-49f4-8273-d8fca38dc7e7 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:30.568121 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5ba5a-8351-49f4-8273-d8fca38dc7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:30.568413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5ba5a-8351-49f4-8273-d8fca38dc7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:30.587063 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-83b5ba5a-8351-49f4-8273-d8fca38dc7e7 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:30.588286 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-83b5ba5a-8351-49f4-8273-d8fca38dc7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:30.605875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:30.649283 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1415/2826] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:30.659030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:30.660452 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:30.723885 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e6894-c3df-4530-9643-746bc5458e86 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:30.728095 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5ba67-83b4-4444-9748-a886ae907280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:30.729273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5ba67-83b4-4444-9748-a886ae907280 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:30.729273 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5ba67-83b4-4444-9748-a886ae907280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:30.729516 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5ba67-83b4-4444-9748-a886ae907280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:30.744374 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5ba67-83b4-4444-9748-a886ae907280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:30.746115 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5ba67-83b4-4444-9748-a886ae907280 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:30.756198 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1412/2827] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:30.844735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83d42-6583-4b97-ab50-1c1af4a9587b None None] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:30.852111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83d42-6583-4b97-ab50-1c1af4a9587b None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:30.852111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c83d42-6583-4b97-ab50-1c1af4a9587b None None] PATH_INFO: `/` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:30.852111 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1416/2828] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:59:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:59:30.854165 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51219537-dc8a-420a-a0ef-793eefde0a83 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:30.854457 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51219537-dc8a-420a-a0ef-793eefde0a83 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:30.854734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51219537-dc8a-420a-a0ef-793eefde0a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:30.872458 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:30.903446 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-51219537-dc8a-420a-a0ef-793eefde0a83 None None] MFA Rules not processed for user `d7a0dbcea7ef4cdd9134f4c5a9cf5fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:30.906975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-51219537-dc8a-420a-a0ef-793eefde0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:30.911864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1413/2829] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:59:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:30.924155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83d42-6583-4b97-ab50-1c1af4a9587b None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:30.935475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c83d42-6583-4b97-ab50-1c1af4a9587b None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:30.939122 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dec79-9b5b-4830-91d9-351899bfdb3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:30.939778 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dec79-9b5b-4830-91d9-351899bfdb3b service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:30.940064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dec79-9b5b-4830-91d9-351899bfdb3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:30.940343 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9dec79-9b5b-4830-91d9-351899bfdb3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:30.948436 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9dec79-9b5b-4830-91d9-351899bfdb3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:30.950244 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9dec79-9b5b-4830-91d9-351899bfdb3b service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:30.959155 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1417/2830] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:31.246309 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51219537-dc8a-420a-a0ef-793eefde0a83 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:31.247767 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-51219537-dc8a-420a-a0ef-793eefde0a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:31.264859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51219537-dc8a-420a-a0ef-793eefde0a83 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:31.270222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:31.273290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:31.273290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:31.273290 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] PATH_INFO: `/v3/projects/d7ae0216af674f65bcebc90679d1d0df` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:31.273883 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7ae0216af674f65bcebc90679d1d0df)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:31.276734 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:31.459421 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7ae0216af674f65bcebc90679d1d0df', 'request_id': 'req-9d305fd5-c40e-405b-a001-aaa5fd6526f8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:31.465919 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7ae0216af674f65bcebc90679d1d0df', 'request_id': 'req-9d305fd5-c40e-405b-a001-aaa5fd6526f8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:31.472344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7ae0216af674f65bcebc90679d1d0df', 'request_id': 'req-9d305fd5-c40e-405b-a001-aaa5fd6526f8'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:31.566101 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] The token cache is being invalidate because project d7ae0216af674f65bcebc90679d1d0df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:31.566401 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:31.567032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-9d305fd5-c40e-405b-a001-aaa5fd6526f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:31.568607 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1414/2831] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:31 2022] DELETE /identity/v3/projects/d7ae0216af674f65bcebc90679d1d0df => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:31.573228 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dec79-9b5b-4830-91d9-351899bfdb3b service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:31.584465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9dec79-9b5b-4830-91d9-351899bfdb3b service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:31.641533 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:31.642430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:31.642714 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:31.642991 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] PATH_INFO: `/v3/users/1a8e7d576bbc4bba9a22fe426be85d5f` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:31.644159 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a8e7d576bbc4bba9a22fe426be85d5f)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:31.646157 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:31.907735 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a8e7d576bbc4bba9a22fe426be85d5f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:31.908563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a8e7d576bbc4bba9a22fe426be85d5f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:32.009795 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a8e7d576bbc4bba9a22fe426be85d5f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:32.012872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a8e7d576bbc4bba9a22fe426be85d5f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:32.024064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cc876f90-fc85-41a1-b0e2-dbf192920456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a8e7d576bbc4bba9a22fe426be85d5f'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:32.037348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1418/2832] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:31 2022] DELETE /identity/v3/users/1a8e7d576bbc4bba9a22fe426be85d5f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:32.081411 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdaed9-2f8b-4020-8dcc-f30292f08717 None None] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:32.087147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdaed9-2f8b-4020-8dcc-f30292f08717 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:32.087147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdaed9-2f8b-4020-8dcc-f30292f08717 None None] PATH_INFO: `/` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:32.087147 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1415/2833] 10.222.0.41 () {54 vars in 921 bytes} [Thu May 26 12:59:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:59:32.091233 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0cd26-6ff7-404f-aa03-af3f83af3cb3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:32.091670 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0cd26-6ff7-404f-aa03-af3f83af3cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:32.092040 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b0cd26-6ff7-404f-aa03-af3f83af3cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:32.136906 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:32.146470 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-a7b0cd26-6ff7-404f-aa03-af3f83af3cb3 None None] MFA Rules not processed for user `a1e4a66515654e1f9f7452740ff4ce58`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:32.148502 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a7b0cd26-6ff7-404f-aa03-af3f83af3cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:32.232355 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1419/2834] 10.222.0.41 () {58 vars in 1018 bytes} [Thu May 26 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:32.243151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdaed9-2f8b-4020-8dcc-f30292f08717 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:32.244944 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-12cdaed9-2f8b-4020-8dcc-f30292f08717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:32.308490 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdaed9-2f8b-4020-8dcc-f30292f08717 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:32.312193 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849bcdeb-e071-4c49-baee-ffd42b3cce95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:32.312868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bcdeb-e071-4c49-baee-ffd42b3cce95 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:32.313183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bcdeb-e071-4c49-baee-ffd42b3cce95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:32.313430 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bcdeb-e071-4c49-baee-ffd42b3cce95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:32.325327 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bcdeb-e071-4c49-baee-ffd42b3cce95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:32.328171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849bcdeb-e071-4c49-baee-ffd42b3cce95 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:32.338771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1416/2835] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:32.536967 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0cd26-6ff7-404f-aa03-af3f83af3cb3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:32.539085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-a7b0cd26-6ff7-404f-aa03-af3f83af3cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:32.610310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b0cd26-6ff7-404f-aa03-af3f83af3cb3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:32.615897 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:32.616825 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:32.617114 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:32.617399 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] PATH_INFO: `/v3/projects/bc5fd52fd3994532b443e6fa0265822b` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:32.618667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc5fd52fd3994532b443e6fa0265822b)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:32.620711 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:32.765344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc5fd52fd3994532b443e6fa0265822b', 'request_id': 'req-3f7520ac-f321-4268-b7e9-06e89a9578cc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:32.770792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc5fd52fd3994532b443e6fa0265822b', 'request_id': 'req-3f7520ac-f321-4268-b7e9-06e89a9578cc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:32.777585 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc5fd52fd3994532b443e6fa0265822b', 'request_id': 'req-3f7520ac-f321-4268-b7e9-06e89a9578cc'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:32.897209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] The token cache is being invalidate because project bc5fd52fd3994532b443e6fa0265822b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:32.898054 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:32.898684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-3f7520ac-f321-4268-b7e9-06e89a9578cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:32.900257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1420/2836] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:32 2022] DELETE /identity/v3/projects/bc5fd52fd3994532b443e6fa0265822b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:32.905058 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32348d-96f6-4273-8362-161eedd56aa0 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:32.905352 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32348d-96f6-4273-8362-161eedd56aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:32.905633 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32348d-96f6-4273-8362-161eedd56aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:32.923512 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-4f32348d-96f6-4273-8362-161eedd56aa0 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:32.924768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4f32348d-96f6-4273-8362-161eedd56aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:32.984349 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1417/2837] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:32.992577 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa810d0-5b3a-4935-ae7a-5b5061432f4f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:32.992876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa810d0-5b3a-4935-ae7a-5b5061432f4f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:32.993231 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa810d0-5b3a-4935-ae7a-5b5061432f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.012156 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-2fa810d0-5b3a-4935-ae7a-5b5061432f4f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:33.013367 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-2fa810d0-5b3a-4935-ae7a-5b5061432f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:33.021451 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1421/2838] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:33.025869 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32348d-96f6-4273-8362-161eedd56aa0 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:33.035500 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32348d-96f6-4273-8362-161eedd56aa0 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:33.040117 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2bbd7-96e0-417d-8472-c799e05dc265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:33.040768 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bbd7-96e0-417d-8472-c799e05dc265 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:33.041080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bbd7-96e0-417d-8472-c799e05dc265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:33.041362 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b2bbd7-96e0-417d-8472-c799e05dc265 admin admin] PATH_INFO: `/v3/domains` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.042120 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2bbd7-96e0-417d-8472-c799e05dc265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80394) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:59:33.042432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2bbd7-96e0-417d-8472-c799e05dc265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:33.044021 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b2bbd7-96e0-417d-8472-c799e05dc265 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:33.050894 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:33.056584 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1418/2839] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:59:33.065148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa810d0-5b3a-4935-ae7a-5b5061432f4f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:33.070667 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:33.074839 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa810d0-5b3a-4935-ae7a-5b5061432f4f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:33.080057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfd915-ee02-46e2-9115-365aca354692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:33.080800 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfd915-ee02-46e2-9115-365aca354692 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:33.081170 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfd915-ee02-46e2-9115-365aca354692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:33.081504 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dfd915-ee02-46e2-9115-365aca354692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.082318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfd915-ee02-46e2-9115-365aca354692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:33.084811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dfd915-ee02-46e2-9115-365aca354692 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:33.187498 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1422/2840] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:59:33 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:33.191847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2bbd7-96e0-417d-8472-c799e05dc265 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:33.202842 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b2bbd7-96e0-417d-8472-c799e05dc265 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:33.263906 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00ff3c-f622-4433-a907-8ef2798c04c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:33.264574 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00ff3c-f622-4433-a907-8ef2798c04c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:33.264857 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00ff3c-f622-4433-a907-8ef2798c04c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:33.265133 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00ff3c-f622-4433-a907-8ef2798c04c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.265848 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00ff3c-f622-4433-a907-8ef2798c04c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:33.267803 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00ff3c-f622-4433-a907-8ef2798c04c5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:33.381951 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1419/2841] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:59:33 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:33.382608 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfd915-ee02-46e2-9115-365aca354692 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:33.387640 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dfd915-ee02-46e2-9115-365aca354692 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:33.392332 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4221c6-5061-4191-9dc0-6fd0eb225f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:33.392999 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4221c6-5061-4191-9dc0-6fd0eb225f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:33.393289 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4221c6-5061-4191-9dc0-6fd0eb225f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:33.393609 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4221c6-5061-4191-9dc0-6fd0eb225f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.394484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4221c6-5061-4191-9dc0-6fd0eb225f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:33.396120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4221c6-5061-4191-9dc0-6fd0eb225f6b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:33.406393 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1423/2842] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:33.411771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00ff3c-f622-4433-a907-8ef2798c04c5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:33.422528 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00ff3c-f622-4433-a907-8ef2798c04c5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:33.427172 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55214f77-09ea-4e4f-9b68-e5c15535e087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:33.427827 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55214f77-09ea-4e4f-9b68-e5c15535e087 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:33.428119 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55214f77-09ea-4e4f-9b68-e5c15535e087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:33.428478 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55214f77-09ea-4e4f-9b68-e5c15535e087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.429772 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55214f77-09ea-4e4f-9b68-e5c15535e087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:33.431391 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55214f77-09ea-4e4f-9b68-e5c15535e087 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:33.441538 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1420/2843] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:33.445801 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4221c6-5061-4191-9dc0-6fd0eb225f6b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:33.455966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4221c6-5061-4191-9dc0-6fd0eb225f6b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:33.460635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826c14-c7f6-4d02-a0bd-8fb67382d03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:33.461499 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826c14-c7f6-4d02-a0bd-8fb67382d03a admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:33.461813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826c14-c7f6-4d02-a0bd-8fb67382d03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:33.462091 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826c14-c7f6-4d02-a0bd-8fb67382d03a admin admin] PATH_INFO: `/v3/projects/9876a2a25bd940acb0b172f848675e56/users/dc5f67b403ab4bc19501c3de99af1c2a/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.477333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66826c14-c7f6-4d02-a0bd-8fb67382d03a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9876a2a25bd940acb0b172f848675e56, user_id=dc5f67b403ab4bc19501c3de99af1c2a, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:33.480010 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66826c14-c7f6-4d02-a0bd-8fb67382d03a admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:33.577907 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1424/2844] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:33 2022] PUT /identity/v3/projects/9876a2a25bd940acb0b172f848675e56/users/dc5f67b403ab4bc19501c3de99af1c2a/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:33.642503 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00146072-51d0-49e8-b451-4db83e1304b5 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:33.642754 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00146072-51d0-49e8-b451-4db83e1304b5 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:33.642979 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00146072-51d0-49e8-b451-4db83e1304b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.669917 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-00146072-51d0-49e8-b451-4db83e1304b5 None None] MFA Rules not processed for user `dc5f67b403ab4bc19501c3de99af1c2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:33.671164 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-00146072-51d0-49e8-b451-4db83e1304b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:33.746599 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1421/2845] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:33.751137 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826c14-c7f6-4d02-a0bd-8fb67382d03a admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:33.814574 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66826c14-c7f6-4d02-a0bd-8fb67382d03a admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:33.819410 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f606d-c2eb-4a34-96af-9699a14ed0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:33.820077 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f606d-c2eb-4a34-96af-9699a14ed0cb admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:33.820363 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f606d-c2eb-4a34-96af-9699a14ed0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:33.820643 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f606d-c2eb-4a34-96af-9699a14ed0cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.821331 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f606d-c2eb-4a34-96af-9699a14ed0cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:33.823275 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f606d-c2eb-4a34-96af-9699a14ed0cb admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:33.905968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1425/2846] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:59:33 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:33.909980 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00146072-51d0-49e8-b451-4db83e1304b5 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:33.921370 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00146072-51d0-49e8-b451-4db83e1304b5 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:33.979032 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040befd-075c-4141-ad24-1c0655d75a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:33.979703 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040befd-075c-4141-ad24-1c0655d75a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:33.979992 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040befd-075c-4141-ad24-1c0655d75a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:33.980275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040befd-075c-4141-ad24-1c0655d75a95 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.980978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040befd-075c-4141-ad24-1c0655d75a95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:33.982929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040befd-075c-4141-ad24-1c0655d75a95 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:33.992429 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:34.130141 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1422/2847] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:59:33 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:34.134557 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f606d-c2eb-4a34-96af-9699a14ed0cb admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:34.144944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f606d-c2eb-4a34-96af-9699a14ed0cb admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:34.150172 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2745-9f13-41dc-a0af-d084efb0bf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:34.150840 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2745-9f13-41dc-a0af-d084efb0bf2d admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.151180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2745-9f13-41dc-a0af-d084efb0bf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.151473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2745-9f13-41dc-a0af-d084efb0bf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.152202 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2745-9f13-41dc-a0af-d084efb0bf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:34.153843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2745-9f13-41dc-a0af-d084efb0bf2d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.165207 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1426/2848] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:34.169264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040befd-075c-4141-ad24-1c0655d75a95 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:34.179732 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040befd-075c-4141-ad24-1c0655d75a95 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:34.184363 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58393cc-9924-4191-a170-455d1d35ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:34.185021 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58393cc-9924-4191-a170-455d1d35ab7c admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.185313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58393cc-9924-4191-a170-455d1d35ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.185598 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58393cc-9924-4191-a170-455d1d35ab7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.186353 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58393cc-9924-4191-a170-455d1d35ab7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:34.187956 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58393cc-9924-4191-a170-455d1d35ab7c admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.198590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1423/2849] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:34.202666 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2745-9f13-41dc-a0af-d084efb0bf2d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:34.213128 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2745-9f13-41dc-a0af-d084efb0bf2d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:34.218146 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67862e1-edf1-43d7-9da2-8f1094eb6a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:34.219020 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67862e1-edf1-43d7-9da2-8f1094eb6a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.219306 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67862e1-edf1-43d7-9da2-8f1094eb6a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.219576 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67862e1-edf1-43d7-9da2-8f1094eb6a96 admin admin] PATH_INFO: `/v3/projects/3cb13e082ed94449868707eeb8a606a5/users/c275f362b3fa4f09b39124578b0a202d/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.234180 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67862e1-edf1-43d7-9da2-8f1094eb6a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb13e082ed94449868707eeb8a606a5, user_id=c275f362b3fa4f09b39124578b0a202d, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:34.236862 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67862e1-edf1-43d7-9da2-8f1094eb6a96 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.298486 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1427/2850] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:34 2022] PUT /identity/v3/projects/3cb13e082ed94449868707eeb8a606a5/users/c275f362b3fa4f09b39124578b0a202d/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:34.308590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37361c8-1ac6-48b9-b36b-e8e53406af42 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.308890 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37361c8-1ac6-48b9-b36b-e8e53406af42 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.309220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37361c8-1ac6-48b9-b36b-e8e53406af42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.338155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-b37361c8-1ac6-48b9-b36b-e8e53406af42 None None] MFA Rules not processed for user `c275f362b3fa4f09b39124578b0a202d`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:34.339453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b37361c8-1ac6-48b9-b36b-e8e53406af42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:34.407080 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1424/2851] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:59:34.411648 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67862e1-edf1-43d7-9da2-8f1094eb6a96 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:34.469452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:34.473057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67862e1-edf1-43d7-9da2-8f1094eb6a96 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:34.477780 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51c718-2017-468a-9012-3d1273492c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:34.481546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51c718-2017-468a-9012-3d1273492c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.481546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51c718-2017-468a-9012-3d1273492c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.481546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51c718-2017-468a-9012-3d1273492c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.481546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51c718-2017-468a-9012-3d1273492c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:34.481546 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51c718-2017-468a-9012-3d1273492c2b admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.579318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1428/2852] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:59:34 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:34.583472 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37361c8-1ac6-48b9-b36b-e8e53406af42 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:34.594493 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37361c8-1ac6-48b9-b36b-e8e53406af42 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:34.650665 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dcd68-5b6d-4f17-b5ce-d954c353f327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:34.651343 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dcd68-5b6d-4f17-b5ce-d954c353f327 admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.651632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dcd68-5b6d-4f17-b5ce-d954c353f327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.651914 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dcd68-5b6d-4f17-b5ce-d954c353f327 admin admin] PATH_INFO: `/v3/users` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.652756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dcd68-5b6d-4f17-b5ce-d954c353f327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:34.654652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dcd68-5b6d-4f17-b5ce-d954c353f327 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.744408 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1425/2853] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:59:34 2022] POST /identity/v3/users => generated 299 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:34.748562 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51c718-2017-468a-9012-3d1273492c2b admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:34.759868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51c718-2017-468a-9012-3d1273492c2b admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:34.764422 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbbc7-15f3-4103-83a2-a22b11845549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:34.765084 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbbc7-15f3-4103-83a2-a22b11845549 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.765370 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbbc7-15f3-4103-83a2-a22b11845549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.765649 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bbbbc7-15f3-4103-83a2-a22b11845549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.766406 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbbbc7-15f3-4103-83a2-a22b11845549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:34.768000 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bbbbc7-15f3-4103-83a2-a22b11845549 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.782089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1429/2854] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:59:34.783254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dcd68-5b6d-4f17-b5ce-d954c353f327 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:34.794260 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dcd68-5b6d-4f17-b5ce-d954c353f327 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:34.798900 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831ae95-70ca-4102-a71e-311ec6999d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:34.799783 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831ae95-70ca-4102-a71e-311ec6999d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.800068 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831ae95-70ca-4102-a71e-311ec6999d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.800344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831ae95-70ca-4102-a71e-311ec6999d17 admin admin] PATH_INFO: `/v3/projects/b0c6bfbb70984b2b9ba834f82d23ef3b/users/27fca984ee1b4e82b874106fdd7431c2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.816509 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831ae95-70ca-4102-a71e-311ec6999d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c6bfbb70984b2b9ba834f82d23ef3b, user_id=27fca984ee1b4e82b874106fdd7431c2, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:34.819839 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831ae95-70ca-4102-a71e-311ec6999d17 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.898402 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1426/2855] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:34 2022] PUT /identity/v3/projects/b0c6bfbb70984b2b9ba834f82d23ef3b/users/27fca984ee1b4e82b874106fdd7431c2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:34.902448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbbc7-15f3-4103-83a2-a22b11845549 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:34.913206 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bbbbc7-15f3-4103-83a2-a22b11845549 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:34.969080 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86469f0e-46c7-419a-84fe-95026b5d5fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:34.969781 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86469f0e-46c7-419a-84fe-95026b5d5fce admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.970069 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86469f0e-46c7-419a-84fe-95026b5d5fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.970354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86469f0e-46c7-419a-84fe-95026b5d5fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.971086 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86469f0e-46c7-419a-84fe-95026b5d5fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:34.972679 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86469f0e-46c7-419a-84fe-95026b5d5fce admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.982845 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1430/2856] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:34.987248 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831ae95-70ca-4102-a71e-311ec6999d17 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:35.003439 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831ae95-70ca-4102-a71e-311ec6999d17 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:35.008104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187be5-ffa0-4b76-b4f6-9f4ac45e9eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:35.009030 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187be5-ffa0-4b76-b4f6-9f4ac45e9eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:35.009313 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187be5-ffa0-4b76-b4f6-9f4ac45e9eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:35.009591 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187be5-ffa0-4b76-b4f6-9f4ac45e9eb5 admin admin] PATH_INFO: `/v3/projects/b0c6bfbb70984b2b9ba834f82d23ef3b/users/27fca984ee1b4e82b874106fdd7431c2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:35.011856 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8187be5-ffa0-4b76-b4f6-9f4ac45e9eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c6bfbb70984b2b9ba834f82d23ef3b, user_id=27fca984ee1b4e82b874106fdd7431c2, role_id=3dc7f53b2f2c4fdd8593cfbd5deee0e3)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:35.014536 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8187be5-ffa0-4b76-b4f6-9f4ac45e9eb5 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:35.025245 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1427/2857] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:34 2022] PUT /identity/v3/projects/b0c6bfbb70984b2b9ba834f82d23ef3b/users/27fca984ee1b4e82b874106fdd7431c2/roles/3dc7f53b2f2c4fdd8593cfbd5deee0e3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:35.035494 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27f50f-afb7-4e2b-b0ed-009dcf7af0c3 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:35.035787 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27f50f-afb7-4e2b-b0ed-009dcf7af0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:35.036070 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d27f50f-afb7-4e2b-b0ed-009dcf7af0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:35.063348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-7d27f50f-afb7-4e2b-b0ed-009dcf7af0c3 None None] MFA Rules not processed for user `27fca984ee1b4e82b874106fdd7431c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:35.064720 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-7d27f50f-afb7-4e2b-b0ed-009dcf7af0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:35.135561 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1431/2858] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:35.149603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187be5-ffa0-4b76-b4f6-9f4ac45e9eb5 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:35.152443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b8187be5-ffa0-4b76-b4f6-9f4ac45e9eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:35.184178 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:35.211104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187be5-ffa0-4b76-b4f6-9f4ac45e9eb5 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:35.214786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d39729-4765-4c1a-a359-dd91ee6866a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:35.215690 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d39729-4765-4c1a-a359-dd91ee6866a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:35.216009 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d39729-4765-4c1a-a359-dd91ee6866a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:35.216300 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d39729-4765-4c1a-a359-dd91ee6866a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:35.274806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d39729-4765-4c1a-a359-dd91ee6866a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:35.276155 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d39729-4765-4c1a-a359-dd91ee6866a6 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:35.285487 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1428/2859] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:37.442281 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27f50f-afb7-4e2b-b0ed-009dcf7af0c3 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:37.452724 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d27f50f-afb7-4e2b-b0ed-009dcf7af0c3 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:37.456348 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e74e33-4e7f-4ac8-8544-f8c2d7463896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:37.456988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e74e33-4e7f-4ac8-8544-f8c2d7463896 service cinder] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:37.457271 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e74e33-4e7f-4ac8-8544-f8c2d7463896 service cinder] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:37.457548 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e74e33-4e7f-4ac8-8544-f8c2d7463896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:37.510924 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:37.521038 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e74e33-4e7f-4ac8-8544-f8c2d7463896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:37.522530 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e74e33-4e7f-4ac8-8544-f8c2d7463896 service cinder] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:37.534426 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1432/2860] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:39.252691 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d39729-4765-4c1a-a359-dd91ee6866a6 service cinder] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:39.261907 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d39729-4765-4c1a-a359-dd91ee6866a6 service cinder] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:39.265540 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1e422-c5d7-493a-9a61-33b9f6b1e077 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:39.266222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1e422-c5d7-493a-9a61-33b9f6b1e077 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:39.266518 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1e422-c5d7-493a-9a61-33b9f6b1e077 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:39.266801 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1e422-c5d7-493a-9a61-33b9f6b1e077 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:39.279111 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1e422-c5d7-493a-9a61-33b9f6b1e077 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:39.280566 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1e422-c5d7-493a-9a61-33b9f6b1e077 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:39.290444 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1429/2861] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:44.132637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e74e33-4e7f-4ac8-8544-f8c2d7463896 service cinder] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:44.194448 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e74e33-4e7f-4ac8-8544-f8c2d7463896 service cinder] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:44.199096 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:44.199995 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:44.200285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:44.200598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] PATH_INFO: `/v3/users/dc5f67b403ab4bc19501c3de99af1c2a` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:44.201867 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc5f67b403ab4bc19501c3de99af1c2a)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:44.203831 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:44.400969 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc5f67b403ab4bc19501c3de99af1c2a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:44.401882 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc5f67b403ab4bc19501c3de99af1c2a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:44.474623 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc5f67b403ab4bc19501c3de99af1c2a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:44.475817 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc5f67b403ab4bc19501c3de99af1c2a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:44.488622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc5f67b403ab4bc19501c3de99af1c2a'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:44.501085 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1433/2862] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:44 2022] DELETE /identity/v3/users/dc5f67b403ab4bc19501c3de99af1c2a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:44.505837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f9c70-e205-48b1-b986-7a1833e03afb None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:44.506301 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f9c70-e205-48b1-b986-7a1833e03afb None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:44.506555 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f9c70-e205-48b1-b986-7a1833e03afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:44.524201 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-5e0f9c70-e205-48b1-b986-7a1833e03afb None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:44.526200 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5e0f9c70-e205-48b1-b986-7a1833e03afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:44.585953 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1430/2863] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:44.595968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:44.597435 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:44.654237 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4a492-73a8-4495-b372-fdaa04d246e2 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:44.657843 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7d7c5-0669-46c0-b2e2-d795f384abf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:44.658534 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7d7c5-0669-46c0-b2e2-d795f384abf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:44.658777 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7d7c5-0669-46c0-b2e2-d795f384abf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:44.659052 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7d7c5-0669-46c0-b2e2-d795f384abf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:44.668616 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7d7c5-0669-46c0-b2e2-d795f384abf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:44.670110 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7d7c5-0669-46c0-b2e2-d795f384abf8 service neutron] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:44.679707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1434/2864] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:45.091465 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f9c70-e205-48b1-b986-7a1833e03afb None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:45.093038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-5e0f9c70-e205-48b1-b986-7a1833e03afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:45.110412 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f9c70-e205-48b1-b986-7a1833e03afb None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:45.116497 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:45.117450 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:45.117859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:45.118204 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] PATH_INFO: `/v3/projects/9876a2a25bd940acb0b172f848675e56` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:45.119502 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9876a2a25bd940acb0b172f848675e56)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:45.121581 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:45.221543 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9876a2a25bd940acb0b172f848675e56', 'request_id': 'req-68864eb9-ccde-474c-819e-c54ba2b52d28'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:45.227104 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9876a2a25bd940acb0b172f848675e56', 'request_id': 'req-68864eb9-ccde-474c-819e-c54ba2b52d28'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:45.233264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9876a2a25bd940acb0b172f848675e56', 'request_id': 'req-68864eb9-ccde-474c-819e-c54ba2b52d28'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:45.234969 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:45.335720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] The token cache is being invalidate because project 9876a2a25bd940acb0b172f848675e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:45.335720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:45.336028 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:45.337388 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1431/2865] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:45 2022] DELETE /identity/v3/projects/9876a2a25bd940acb0b172f848675e56 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:45.341707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7d7c5-0669-46c0-b2e2-d795f384abf8 service neutron] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:45.352113 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7d7c5-0669-46c0-b2e2-d795f384abf8 service neutron] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:45.360889 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:45.408628 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:45.410089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:45.410392 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:45.410509 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] PATH_INFO: `/v3/users/c275f362b3fa4f09b39124578b0a202d` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:45.411690 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c275f362b3fa4f09b39124578b0a202d)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:45.414169 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:45.602792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c275f362b3fa4f09b39124578b0a202d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:45.603458 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c275f362b3fa4f09b39124578b0a202d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:45.678729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c275f362b3fa4f09b39124578b0a202d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:45.679354 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c275f362b3fa4f09b39124578b0a202d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:45.691881 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c275f362b3fa4f09b39124578b0a202d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:45.704076 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1435/2866] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:45 2022] DELETE /identity/v3/users/c275f362b3fa4f09b39124578b0a202d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:46.202090 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:46.203557 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:46.218326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68864eb9-ccde-474c-819e-c54ba2b52d28 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:46.276330 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:46.277185 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:46.277470 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:46.277806 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] PATH_INFO: `/v3/projects/3cb13e082ed94449868707eeb8a606a5` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:46.278983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb13e082ed94449868707eeb8a606a5)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:46.280880 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:46.406615 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb13e082ed94449868707eeb8a606a5', 'request_id': 'req-1473aeac-d131-4ede-8869-cef25ba75e5f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:46.412721 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb13e082ed94449868707eeb8a606a5', 'request_id': 'req-1473aeac-d131-4ede-8869-cef25ba75e5f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:46.419275 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb13e082ed94449868707eeb8a606a5', 'request_id': 'req-1473aeac-d131-4ede-8869-cef25ba75e5f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:46.525636 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] The token cache is being invalidate because project 3cb13e082ed94449868707eeb8a606a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:46.525983 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:46.526606 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:46.528251 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1432/2867] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:46 2022] DELETE /identity/v3/projects/3cb13e082ed94449868707eeb8a606a5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:46.532136 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:46.533729 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:46.547457 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb0d161-9f5d-44d3-b1f5-066a9cd6d0ca admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:46.602547 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:46.603413 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:46.603697 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:46.603973 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] PATH_INFO: `/v3/users/27fca984ee1b4e82b874106fdd7431c2` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:46.605131 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fca984ee1b4e82b874106fdd7431c2)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:46.607095 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:46.798420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:46.809344 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fca984ee1b4e82b874106fdd7431c2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:46.810057 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fca984ee1b4e82b874106fdd7431c2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:46.878642 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fca984ee1b4e82b874106fdd7431c2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:46.879396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fca984ee1b4e82b874106fdd7431c2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:46.893484 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-b58a5316-1988-4f91-a83f-06e6b67f8e57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fca984ee1b4e82b874106fdd7431c2'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:46.905988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1436/2868] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 12:59:46 2022] DELETE /identity/v3/users/27fca984ee1b4e82b874106fdd7431c2 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:47.310859 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:47.312558 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:47.328406 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473aeac-d131-4ede-8869-cef25ba75e5f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:47.394871 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:47.395778 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:47.396062 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:47.396344 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] PATH_INFO: `/v3/projects/b0c6bfbb70984b2b9ba834f82d23ef3b` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:47.398195 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c6bfbb70984b2b9ba834f82d23ef3b)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:47.400114 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:47.426975 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:INSERT=2,keystone:DELETE=9,keystone:SELECT=89 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:47.559864 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c6bfbb70984b2b9ba834f82d23ef3b', 'request_id': 'req-fcc57fe1-b263-4be7-85a6-9d0b24837135'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:47.565229 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c6bfbb70984b2b9ba834f82d23ef3b', 'request_id': 'req-fcc57fe1-b263-4be7-85a6-9d0b24837135'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:47.572541 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c6bfbb70984b2b9ba834f82d23ef3b', 'request_id': 'req-fcc57fe1-b263-4be7-85a6-9d0b24837135'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:47.788774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] The token cache is being invalidate because project b0c6bfbb70984b2b9ba834f82d23ef3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80394) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:47.789078 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:47.789840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-fcc57fe1-b263-4be7-85a6-9d0b24837135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:47.791443 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1433/2869] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 12:59:47 2022] DELETE /identity/v3/projects/b0c6bfbb70984b2b9ba834f82d23ef3b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:47.796366 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880ef06-b325-43f8-b45e-36c0ab7f9ae2 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:47.796879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880ef06-b325-43f8-b45e-36c0ab7f9ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:47.797064 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880ef06-b325-43f8-b45e-36c0ab7f9ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:47.815416 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-b880ef06-b325-43f8-b45e-36c0ab7f9ae2 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:47.816785 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-b880ef06-b325-43f8-b45e-36c0ab7f9ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:47.875661 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1437/2870] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:47.884038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5be540-69c1-4807-bdba-2efceb21fbc9 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:47.884340 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5be540-69c1-4807-bdba-2efceb21fbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:47.884630 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5be540-69c1-4807-bdba-2efceb21fbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:47.903753 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-3b5be540-69c1-4807-bdba-2efceb21fbc9 None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:47.905942 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-3b5be540-69c1-4807-bdba-2efceb21fbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:47.912971 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1434/2871] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:47.917214 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880ef06-b325-43f8-b45e-36c0ab7f9ae2 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:47.927235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880ef06-b325-43f8-b45e-36c0ab7f9ae2 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:47.931872 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c0948-8a1a-4672-ad61-14953d6e1351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:47.934625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c0948-8a1a-4672-ad61-14953d6e1351 admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:47.934625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c0948-8a1a-4672-ad61-14953d6e1351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:47.934625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c0948-8a1a-4672-ad61-14953d6e1351 admin admin] PATH_INFO: `/v3/domains` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:47.934625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c0948-8a1a-4672-ad61-14953d6e1351 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80393) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:59:47.934625 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c0948-8a1a-4672-ad61-14953d6e1351 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:47.935727 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c0948-8a1a-4672-ad61-14953d6e1351 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:47.947882 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1438/2872] 10.222.0.41 () {58 vars in 1152 bytes} [Thu May 26 12:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:59:47.952082 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5be540-69c1-4807-bdba-2efceb21fbc9 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:47.962070 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5be540-69c1-4807-bdba-2efceb21fbc9 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:47.969220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de64b0-0460-4b4e-add2-566f2b886f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:47.969220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de64b0-0460-4b4e-add2-566f2b886f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:47.969220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de64b0-0460-4b4e-add2-566f2b886f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:47.969220 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de64b0-0460-4b4e-add2-566f2b886f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:47.969713 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de64b0-0460-4b4e-add2-566f2b886f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:47.971018 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de64b0-0460-4b4e-add2-566f2b886f2f admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:48.047929 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1435/2873] 10.222.0.41 () {60 vars in 1152 bytes} [Thu May 26 12:59:47 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:59:48.051911 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c0948-8a1a-4672-ad61-14953d6e1351 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:48.062599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c0948-8a1a-4672-ad61-14953d6e1351 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:48.119753 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e67b1-9bff-4117-bb08-38c0a4e555d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:48.120420 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e67b1-9bff-4117-bb08-38c0a4e555d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:48.120709 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e67b1-9bff-4117-bb08-38c0a4e555d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:48.120989 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e67b1-9bff-4117-bb08-38c0a4e555d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:48.121692 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e67b1-9bff-4117-bb08-38c0a4e555d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:48.123682 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e67b1-9bff-4117-bb08-38c0a4e555d9 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:48.217474 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1439/2874] 10.222.0.41 () {60 vars in 1143 bytes} [Thu May 26 12:59:48 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:48.221526 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de64b0-0460-4b4e-add2-566f2b886f2f admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:48.231882 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de64b0-0460-4b4e-add2-566f2b886f2f admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:48.236570 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31864cec-ea79-4bab-bfa0-d8bb3be0b3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:48.237222 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31864cec-ea79-4bab-bfa0-d8bb3be0b3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:48.237511 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31864cec-ea79-4bab-bfa0-d8bb3be0b3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:48.237821 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31864cec-ea79-4bab-bfa0-d8bb3be0b3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:48.238617 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31864cec-ea79-4bab-bfa0-d8bb3be0b3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:48.240209 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31864cec-ea79-4bab-bfa0-d8bb3be0b3d9 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:48.251020 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1436/2875] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:48.254958 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e67b1-9bff-4117-bb08-38c0a4e555d9 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:48.265734 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e67b1-9bff-4117-bb08-38c0a4e555d9 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:48.270360 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5da87-26f4-4e84-bbc4-89f108bdf5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:48.271009 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5da87-26f4-4e84-bbc4-89f108bdf5ab admin admin] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:48.271294 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5da87-26f4-4e84-bbc4-89f108bdf5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:48.271571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5da87-26f4-4e84-bbc4-89f108bdf5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:48.272598 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5da87-26f4-4e84-bbc4-89f108bdf5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:48.274374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5da87-26f4-4e84-bbc4-89f108bdf5ab admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:48.284278 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1440/2876] 10.222.0.41 () {58 vars in 1121 bytes} [Thu May 26 12:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:48.288422 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31864cec-ea79-4bab-bfa0-d8bb3be0b3d9 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:48.298872 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31864cec-ea79-4bab-bfa0-d8bb3be0b3d9 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:48.304513 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828aa5c-6741-4b53-85a9-ab23f2b38f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:48.305395 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828aa5c-6741-4b53-85a9-ab23f2b38f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:48.305748 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828aa5c-6741-4b53-85a9-ab23f2b38f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:48.306038 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828aa5c-6741-4b53-85a9-ab23f2b38f5e admin admin] PATH_INFO: `/v3/projects/bfbb1ec8872f42218abf14ed8ada2e89/users/42918efc43ac4c96b5b5cb8f0c9ae52a/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:48.321419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828aa5c-6741-4b53-85a9-ab23f2b38f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfbb1ec8872f42218abf14ed8ada2e89, user_id=42918efc43ac4c96b5b5cb8f0c9ae52a, role_id=0f5f4ca1a0b54645ad52288d7c6e3a2d)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:48.324183 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828aa5c-6741-4b53-85a9-ab23f2b38f5e admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:48.470279 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1437/2877] 10.222.0.41 () {60 vars in 1482 bytes} [Thu May 26 12:59:48 2022] PUT /identity/v3/projects/bfbb1ec8872f42218abf14ed8ada2e89/users/42918efc43ac4c96b5b5cb8f0c9ae52a/roles/0f5f4ca1a0b54645ad52288d7c6e3a2d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:48.488660 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873de30-099d-45d6-ad74-5d6121e217dd None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:48.488942 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873de30-099d-45d6-ad74-5d6121e217dd None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:48.489225 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873de30-099d-45d6-ad74-5d6121e217dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:48.517803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-e873de30-099d-45d6-ad74-5d6121e217dd None None] MFA Rules not processed for user `42918efc43ac4c96b5b5cb8f0c9ae52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:48.519031 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-e873de30-099d-45d6-ad74-5d6121e217dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:48.524350 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:48.583318 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1441/2878] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:48.594026 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828aa5c-6741-4b53-85a9-ab23f2b38f5e admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:48.595795 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8828aa5c-6741-4b53-85a9-ab23f2b38f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:48.655367 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828aa5c-6741-4b53-85a9-ab23f2b38f5e admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:48.659181 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d151e47-9fd9-4a7e-b16f-a6432e1dd884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '395e7e721bf349f2bee876a23fc12291', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:48.659837 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d151e47-9fd9-4a7e-b16f-a6432e1dd884 service cinder] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:48.660123 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d151e47-9fd9-4a7e-b16f-a6432e1dd884 service cinder] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:48.660410 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d151e47-9fd9-4a7e-b16f-a6432e1dd884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:48.670847 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d151e47-9fd9-4a7e-b16f-a6432e1dd884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:48.672403 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d151e47-9fd9-4a7e-b16f-a6432e1dd884 service cinder] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:48.682324 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1438/2879] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 12:59:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:50.390588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827359d1-fa8d-48e0-aa29-afaa08aef157 None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:50.391119 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827359d1-fa8d-48e0-aa29-afaa08aef157 None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:50.391235 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827359d1-fa8d-48e0-aa29-afaa08aef157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:50.409288 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-827359d1-fa8d-48e0-aa29-afaa08aef157 None None] MFA Rules not processed for user `42918efc43ac4c96b5b5cb8f0c9ae52a`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:50.410528 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-827359d1-fa8d-48e0-aa29-afaa08aef157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:50.418120 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1442/2880] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 12:59:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:58.677432 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=68,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:00.403879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=27 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:07.989962 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068e76c-9b22-4738-9f3b-175515b6ec3c None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:07.990453 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068e76c-9b22-4738-9f3b-175515b6ec3c None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:07.990731 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068e76c-9b22-4738-9f3b-175515b6ec3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:08.040902 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e068e76c-9b22-4738-9f3b-175515b6ec3c None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:08.042180 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e068e76c-9b22-4738-9f3b-175515b6ec3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:08.112281 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1439/2881] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 13:00:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:08.258813 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827359d1-fa8d-48e0-aa29-afaa08aef157 None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:08.260284 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-827359d1-fa8d-48e0-aa29-afaa08aef157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:08.353379 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827359d1-fa8d-48e0-aa29-afaa08aef157 None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:08.358831 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8890e40-698b-4a7e-b24e-e422f71f4db7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:08.359514 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890e40-698b-4a7e-b24e-e422f71f4db7 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:08.359803 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890e40-698b-4a7e-b24e-e422f71f4db7 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:08.360083 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8890e40-698b-4a7e-b24e-e422f71f4db7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:08.368333 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8890e40-698b-4a7e-b24e-e422f71f4db7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:08.369966 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8890e40-698b-4a7e-b24e-e422f71f4db7 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:08.377792 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1443/2882] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 13:00:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:00:09.247254 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333e15-539b-44b0-944f-3c45fb61c0ec None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:09.247756 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333e15-539b-44b0-944f-3c45fb61c0ec None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:09.247868 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333e15-539b-44b0-944f-3c45fb61c0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:09.267958 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-80333e15-539b-44b0-944f-3c45fb61c0ec None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:09.269308 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-80333e15-539b-44b0-944f-3c45fb61c0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:09.276664 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1440/2883] 10.222.0.41 () {58 vars in 967 bytes} [Thu May 26 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:09.290092 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8890e40-698b-4a7e-b24e-e422f71f4db7 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:09.301374 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8890e40-698b-4a7e-b24e-e422f71f4db7 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:09.306946 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a33a8-9ae4-48d8-b334-74ba5022fa21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:09.307588 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a33a8-9ae4-48d8-b334-74ba5022fa21 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:09.307879 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a33a8-9ae4-48d8-b334-74ba5022fa21 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:09.308150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a33a8-9ae4-48d8-b334-74ba5022fa21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:09.317210 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a33a8-9ae4-48d8-b334-74ba5022fa21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:09.318926 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a33a8-9ae4-48d8-b334-74ba5022fa21 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:09.328923 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1444/2884] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 13:00:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:00:09.966552 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537d538-862b-4496-bfdd-6ccd03b8eb11 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:09.966836 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537d538-862b-4496-bfdd-6ccd03b8eb11 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:09.967122 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537d538-862b-4496-bfdd-6ccd03b8eb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:09.990423 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-e537d538-862b-4496-bfdd-6ccd03b8eb11 None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:09.991655 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-e537d538-862b-4496-bfdd-6ccd03b8eb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:09.999171 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1441/2885] 10.222.0.41 () {58 vars in 1009 bytes} [Thu May 26 13:00:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:10.010928 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a33a8-9ae4-48d8-b334-74ba5022fa21 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:10.022430 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a33a8-9ae4-48d8-b334-74ba5022fa21 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:10.028257 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dea7c-241f-4181-b74c-1e23308bd929 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:10.028908 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dea7c-241f-4181-b74c-1e23308bd929 service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:10.029196 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dea7c-241f-4181-b74c-1e23308bd929 service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:10.029475 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3dea7c-241f-4181-b74c-1e23308bd929 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:10.039144 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dea7c-241f-4181-b74c-1e23308bd929 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:10.040738 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3dea7c-241f-4181-b74c-1e23308bd929 service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:10.049336 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1445/2886] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 13:00:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:00:10.613603 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ab0a-c5d5-43a3-93e9-617842363293 None None] REQUEST_METHOD: `POST` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:10.614140 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ab0a-c5d5-43a3-93e9-617842363293 None None] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:10.614326 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ab0a-c5d5-43a3-93e9-617842363293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:10.633087 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.auth.core [None req-33d8ab0a-c5d5-43a3-93e9-617842363293 None None] MFA Rules not processed for user `2393ed59b5e74a99ae55f15bdc2b5519`. Rule list: `[]` (Enabled: `True`). {{(pid=80394) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:10.634341 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-33d8ab0a-c5d5-43a3-93e9-617842363293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:10.642014 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1442/2887] 10.222.0.41 () {58 vars in 967 bytes} [Thu May 26 13:00:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:10.654033 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dea7c-241f-4181-b74c-1e23308bd929 service swift] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:10.665508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3dea7c-241f-4181-b74c-1e23308bd929 service swift] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:10.670571 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb686b2-31e9-4b97-bc05-831366bd9f1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af5ebb39734144418fe35f9f0a679145', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:10.671211 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb686b2-31e9-4b97-bc05-831366bd9f1c service swift] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:10.671497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb686b2-31e9-4b97-bc05-831366bd9f1c service swift] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:10.671775 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb686b2-31e9-4b97-bc05-831366bd9f1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:10.680935 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb686b2-31e9-4b97-bc05-831366bd9f1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:10.682563 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb686b2-31e9-4b97-bc05-831366bd9f1c service swift] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:10.690933 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1446/2888] 10.222.0.41 () {60 vars in 1384 bytes} [Thu May 26 13:00:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 13:00:13.591959 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ab0a-c5d5-43a3-93e9-617842363293 None None] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:13.655109 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ab0a-c5d5-43a3-93e9-617842363293 None None] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:13.660774 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:13.661306 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:13.661592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:13.661893 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] PATH_INFO: `/v3/users/42918efc43ac4c96b5b5cb8f0c9ae52a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:13.663127 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42918efc43ac4c96b5b5cb8f0c9ae52a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:13.665700 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:13.858903 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42918efc43ac4c96b5b5cb8f0c9ae52a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:13.931132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42918efc43ac4c96b5b5cb8f0c9ae52a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:13.931686 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42918efc43ac4c96b5b5cb8f0c9ae52a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:13.932298 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42918efc43ac4c96b5b5cb8f0c9ae52a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:13.933706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:13.945371 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42918efc43ac4c96b5b5cb8f0c9ae52a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:13.957315 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1443/2889] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 13:00:13 2022] DELETE /identity/v3/users/42918efc43ac4c96b5b5cb8f0c9ae52a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:00:13.962397 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31d23-57e0-413a-8b3f-5867ef8f024f None None] REQUEST_METHOD: `POST` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:13.962868 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31d23-57e0-413a-8b3f-5867ef8f024f None None] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:13.962967 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c31d23-57e0-413a-8b3f-5867ef8f024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:13.982268 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.auth.core [None req-71c31d23-57e0-413a-8b3f-5867ef8f024f None None] MFA Rules not processed for user `46fa2a18bf5f49108e7df3a32506426e`. Rule list: `[]` (Enabled: `True`). {{(pid=80393) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:13.983622 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-71c31d23-57e0-413a-8b3f-5867ef8f024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:14.042321 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1447/2890] 10.222.0.41 () {58 vars in 957 bytes} [Thu May 26 13:00:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:00:14.051843 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:14.053291 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:14.112130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20a635-b051-4bad-9375-24562c27b476 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:14.115751 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82562d6d-c491-4b91-af23-c778c36c2c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:14.116397 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82562d6d-c491-4b91-af23-c778c36c2c04 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:14.117475 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82562d6d-c491-4b91-af23-c778c36c2c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:14.117786 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82562d6d-c491-4b91-af23-c778c36c2c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:14.126966 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82562d6d-c491-4b91-af23-c778c36c2c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:14.128419 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82562d6d-c491-4b91-af23-c778c36c2c04 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:14.137884 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1444/2891] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 13:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:00:14.412002 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31d23-57e0-413a-8b3f-5867ef8f024f None None] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:14.414079 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-71c31d23-57e0-413a-8b3f-5867ef8f024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:14.426544 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c31d23-57e0-413a-8b3f-5867ef8f024f None None] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:14.431212 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:14.432150 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:14.432414 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:14.432653 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] PATH_INFO: `/v3/projects/bfbb1ec8872f42218abf14ed8ada2e89` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:14.433876 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfbb1ec8872f42218abf14ed8ada2e89)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:14.435875 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:14.550285 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:14.568797 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfbb1ec8872f42218abf14ed8ada2e89', 'request_id': 'req-cb9a73a7-e762-47b8-8da3-2301023a5cc0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:14.574988 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfbb1ec8872f42218abf14ed8ada2e89', 'request_id': 'req-cb9a73a7-e762-47b8-8da3-2301023a5cc0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:14.581209 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfbb1ec8872f42218abf14ed8ada2e89', 'request_id': 'req-cb9a73a7-e762-47b8-8da3-2301023a5cc0'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:14.673684 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] The token cache is being invalidate because project bfbb1ec8872f42218abf14ed8ada2e89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:00:14.673981 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:14.674604 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:14.676148 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1448/2892] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 13:00:14 2022] DELETE /identity/v3/projects/bfbb1ec8872f42218abf14ed8ada2e89 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:00:24.133652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=37,keystone:DELETE=2 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:24.679310 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:07.870608 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82562d6d-c491-4b91-af23-c778c36c2c04 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:01:07.879652 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82562d6d-c491-4b91-af23-c778c36c2c04 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:01:07.932154 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099a225-38d5-4cbd-9eaa-b3016593d459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7a0dbcea7ef4cdd9134f4c5a9cf5fb5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:01:07.932706 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099a225-38d5-4cbd-9eaa-b3016593d459 service neutron] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:07.932986 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099a225-38d5-4cbd-9eaa-b3016593d459 service neutron] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:07.933264 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099a225-38d5-4cbd-9eaa-b3016593d459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:07.935215 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b099a225-38d5-4cbd-9eaa-b3016593d459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:08.010771 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099a225-38d5-4cbd-9eaa-b3016593d459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:01:08.012216 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b099a225-38d5-4cbd-9eaa-b3016593d459 service neutron] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:01:08.024317 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1445/2893] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 13:01:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:01:15.469362 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:01:15.471516 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:15.541693 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a73a7-e762-47b8-8da3-2301023a5cc0 admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:01:15.546942 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b8f6-a3b1-4c61-ad05-8af48fd65af0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:01:15.547599 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b8f6-a3b1-4c61-ad05-8af48fd65af0 service placement] REQUEST_METHOD: `GET` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:15.547884 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b8f6-a3b1-4c61-ad05-8af48fd65af0 service placement] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:15.548161 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09b8f6-a3b1-4c61-ad05-8af48fd65af0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:15.550019 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-1d09b8f6-a3b1-4c61-ad05-8af48fd65af0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:15.561396 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b8f6-a3b1-4c61-ad05-8af48fd65af0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:01:15.563039 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09b8f6-a3b1-4c61-ad05-8af48fd65af0 service placement] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:01:15.572739 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1449/2894] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 13:01:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:01:18.019592 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=54 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:19.198719 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099a225-38d5-4cbd-9eaa-b3016593d459 service neutron] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:01:19.200137 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-b099a225-38d5-4cbd-9eaa-b3016593d459 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:19.265622 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099a225-38d5-4cbd-9eaa-b3016593d459 service neutron] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:01:19.271556 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:01:19.273294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:19.273294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:19.273294 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] PATH_INFO: `/v3/users/e03ca4f264eb42ddbe92f5cb95d9fc2f` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:19.274210 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03ca4f264eb42ddbe92f5cb95d9fc2f)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:01:19.276130 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:01:19.462289 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03ca4f264eb42ddbe92f5cb95d9fc2f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:19.557930 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03ca4f264eb42ddbe92f5cb95d9fc2f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:19.558545 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03ca4f264eb42ddbe92f5cb95d9fc2f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:19.559156 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03ca4f264eb42ddbe92f5cb95d9fc2f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:19.571693 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03ca4f264eb42ddbe92f5cb95d9fc2f'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:19.583799 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1446/2895] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 13:01:19 2022] DELETE /identity/v3/users/e03ca4f264eb42ddbe92f5cb95d9fc2f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:01:19.828368 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b8f6-a3b1-4c61-ad05-8af48fd65af0 service placement] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:01:19.839968 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09b8f6-a3b1-4c61-ad05-8af48fd65af0 service placement] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:01:19.897614 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:01:19.898497 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:19.898811 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:19.899089 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] PATH_INFO: `/v3/projects/0c2ea80ac0374c2c870a494adc6534ff` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:19.900261 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c2ea80ac0374c2c870a494adc6534ff)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:01:19.902217 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:01:20.005026 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c2ea80ac0374c2c870a494adc6534ff', 'request_id': 'req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:20.011779 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c2ea80ac0374c2c870a494adc6534ff', 'request_id': 'req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:20.024358 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c2ea80ac0374c2c870a494adc6534ff', 'request_id': 'req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:20.220559 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] The token cache is being invalidate because project 0c2ea80ac0374c2c870a494adc6534ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:01:20.220848 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:20.221465 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:20.223635 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1450/2896] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 13:01:19 2022] DELETE /identity/v3/projects/0c2ea80ac0374c2c870a494adc6534ff => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:01:20.227576 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:01:20.228981 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:20.242433 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890a2fc-58e2-4b3b-a8de-5779243ea810 admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:01:20.298356 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:01:20.299221 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:20.299501 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:20.299797 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] PATH_INFO: `/v3/users/b1cd1a67116d461f8db90b03aa508a8a` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:20.300978 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1cd1a67116d461f8db90b03aa508a8a)` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:01:20.302921 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:01:20.324632 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:20.560186 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1cd1a67116d461f8db90b03aa508a8a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:20.655132 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1cd1a67116d461f8db90b03aa508a8a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:20.655761 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1cd1a67116d461f8db90b03aa508a8a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:20.656373 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1cd1a67116d461f8db90b03aa508a8a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:20.668548 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.notifications [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1cd1a67116d461f8db90b03aa508a8a'} {{(pid=80394) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:20.681586 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1447/2897] 10.222.0.41 () {58 vars in 1223 bytes} [Thu May 26 13:01:20 2022] DELETE /identity/v3/users/b1cd1a67116d461f8db90b03aa508a8a => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:01:20.897442 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] Authenticating user token {{(pid=80393) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:01:20.898944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.fernet_utils [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80393) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:20.911847 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecd0ed-4f80-4f94-85ed-2e2491ae151d admin admin] Validating token access rules against request {{(pid=80393) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:01:20.929944 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:20.971473 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46fa2a18bf5f49108e7df3a32506426e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '787f9c4d2f4e4a9fbcf0543d5d8232c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80393) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:01:20.972637 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:20.972927 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:20.973203 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] PATH_INFO: `/v3/projects/71386e31a72f4593b49207e152a5e6a7` {{(pid=80393) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:20.974452 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=71386e31a72f4593b49207e152a5e6a7)` {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:01:20.976919 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] RBAC: Authorization granted {{(pid=80393) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:01:21.093707 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71386e31a72f4593b49207e152a5e6a7', 'request_id': 'req-1c7852d6-3bce-46e9-9625-57f8f725f11e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:21.099508 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71386e31a72f4593b49207e152a5e6a7', 'request_id': 'req-1c7852d6-3bce-46e9-9625-57f8f725f11e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:21.105587 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71386e31a72f4593b49207e152a5e6a7', 'request_id': 'req-1c7852d6-3bce-46e9-9625-57f8f725f11e'} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:21.224822 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] The token cache is being invalidate because project 71386e31a72f4593b49207e152a5e6a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80393) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:01:21.225024 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:21.225683 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG keystone.notifications [None req-1c7852d6-3bce-46e9-9625-57f8f725f11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80393) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:01:21.227245 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: [pid: 80393|app: 0|req: 1451/2898] 10.222.0.41 () {58 vars in 1232 bytes} [Thu May 26 13:01:20 2022] DELETE /identity/v3/projects/71386e31a72f4593b49207e152a5e6a7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:01:30.706590 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:31.220951 dv-cinder-815712-9-iscsi devstack@keystone.service[80393]: DEBUG dbcounter [-] [80393] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80393) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:16.078151 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] Authenticating user token {{(pid=80394) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:04:16.079745 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:04:16.151302 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0da91-3d91-49a9-93ed-f89b074971fa admin admin] Validating token access rules against request {{(pid=80394) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:04:16.208846 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d396039-793e-4976-a5a6-bf14e9cc1a30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0412209ee10a46558a8baf10b59f89a7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31b334e262244d57bc2ef756a3ae6797', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80394) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:04:16.209489 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d396039-793e-4976-a5a6-bf14e9cc1a30 service placement] REQUEST_METHOD: `GET` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:04:16.209813 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d396039-793e-4976-a5a6-bf14e9cc1a30 service placement] SCRIPT_NAME: `/identity` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:04:16.210097 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d396039-793e-4976-a5a6-bf14e9cc1a30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80394) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:04:16.212134 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.fernet_utils [None req-0d396039-793e-4976-a5a6-bf14e9cc1a30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80394) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:04:16.223094 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d396039-793e-4976-a5a6-bf14e9cc1a30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:04:16.224720 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d396039-793e-4976-a5a6-bf14e9cc1a30 service placement] RBAC: Authorization granted {{(pid=80394) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:04:16.235019 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: [pid: 80394|app: 0|req: 1448/2899] 10.222.0.41 () {60 vars in 1365 bytes} [Thu May 26 13:04:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:04:26.230840 dv-cinder-815712-9-iscsi devstack@keystone.service[80394]: DEBUG dbcounter [-] [80394] Writing DB stats keystone:SELECT=58 {{(pid=80394) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}